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(57) A transmitting apparatus for an interactive com* 
munication system using a broadcast wave is provided. 
The transmitting apparatus comprises a first storing unit 
for storing a plurality of frames of image data : a second 
storing unit for storing control information, for each 
frame of image data, showing a link to another frame of 
image data stored in the first storing unit : and a trans- 
mitting unit for repeatedly transmitting a predetermined 
number of frames of image data together with corre- 
sponding control information. 
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Description 

BACKGROUND OF THE INVENTION 

( 1 ) Field of the Invention s 

The present invention relates to a data communica- 
tion system, and to a data transmitting apparatus and 
data receiving apparatus in the system., where simulat- 
ed bidirectional commun ication processing is performed 10 
between a data transmitting apparatus and a data re- 
ceiving apparatus using one-way communication., such 
as a television (TV) broadcast. 

(2) Description of the Prior Art is 

It is now possible to connect personal computers in 
the home to networks using a standard telephone line 
and so receive a great variety of information provided 
by servers around the world. The most representative 20 
example of such a network is the World Wide Web 
(WWW) on the Internet. WWW servers transmit a com- 
bination of image information and control information 
which has the image information displayed within text 
information, to personal computers as the data for dis- 25 
playing a one-page image on the personal computer's 
screen. When such pages are made up of text informa- 
tion alone, only control information for displaying this 
text information is transmitted. This control information 
is written using HTML (HyperText Markup Language). 30 
with browser software executed by the personal com- 
puter decoding and executing the HTML code to display 
each page on the WWW which is downloaded by the 
user. Here, information indicating a link to another page 
can be attached to character strings and images in a 35 
page, so that when the user makes a selection operation 
for such a character string or image using a mouse, for 
example, the browser will access the WWW server that 
provides the indicated page and will obtain the informa- 
tion for displaying this new page. On obtaining this in- -to 
formation, the browser will decode and execute its con- 
tent to display the new page. 

Japanese Laid-Open Patent Application 7-322226 
(1 995) discloses a method for multiplexing control infor- 
mation that can generate the kind of interactive display 
described above into a TV broadcast which is transmit- 
ted using a TV broadcast ground wave. In this method, 
the program transmitting apparatus multiplexes data, 
written in a language which resembles HTML for com- 
posing an interactive screen, into a program broadcast so 
before transmitting. On receiving this broadcast, the 
program receiving apparatus interprets the composition 
of the interactive screen and combines basic display el- 
ements which have been stored inside its structure in 
accordance with the indicated composition to compose 55 
the interactive screen. 

The above method has a major drawback in that the 
control information is written in a language for indicating 
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a variety of control operations which are performed for 
display, so that the receiving apparatus needs to inter- 
pret and execute these control operations one by one 
to perform display. Additionally, most high resolution im- 
ages provided by WWW servers are compressed using 
complex techniques, so that when a receiving apparatus 
attempts to display such image information, it is usually 
necessary to perform decompression in addition to the 
processes for display in accordance with the control in- 
formation. Since such complex processing is required, 
the load of the receiving apparatus is considerable, 
which greatly increases the cost of the necessary hard- 
ware for the receiving apparatus. 

With the above program receiving apparatus, the 
contents of a broadcast program cannot be changed in- 
teractively through a composed interactive screen. 

SUMMARY OF THE INVENTION 

It is therefore the first object of the present invention 
to provide a transmitting apparatus, a receiving appara- 
tus: a receiving method, a recording medium for record- 
ing a receiving program, and a communication system, 
for performing simulated bidirectional processing be- 
tween a data transmitting apparatus and a data receiv- 
ing apparatus without increasing the load of the data re- 
ceiving apparatus in a one-way communication system, 
such as a TV broadcast. 

A transmitting apparatus which can achieve the 
above object should comprise: a first storing unit for stor- 
ing a plurality of frames of image data: a second storing 
unit for storing control information showing links be- 
tween the plurality of frames of image data stored in the 
first storing unit: and a transmitting unit for repeatedly 
transmitting a predetermined number of frames of im- 
age data together with corresponding control informa- 
tion. 

The transmitting apparatus having this structure re- 
peatedly transmits image data and corresponding con- 
trol information. The receiving apparatus can receive 
the linked image data expressed by the control informa- 
tion without fail, so that users can interactively trace from 
one frame of image data to another. As a result, users 
can feel as if having a bidirectional communication using 
a one-way broadcast wave. 

With a conventional bidirectional server the load 
greatly varies depending on the amount of request from 
the receiving apparatus, which have influence on the re- 
sponse time from receiving an operation instruction until 
switching display images. On the other hand, the load 
of the transmitting apparatus of the present invention 
does not vary so that the repetitive transmission cycle 
can be fixed. Thus, in the receiving apparatus of the 
present invention, image data can be switched within a 
predetermined response time, that is, within one cycle 
of the repetitive transmission. 

The transmitting unit of the transmitting apparatus 
may comprise: a reading unit for repeatedly reading a 
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predetermined number of frames of image data together 
with corresponding control information from the first and 
second storing units; a multiplexing unit for multiplexing 
image the image data and the corresponding control in- 
formation read by transmitting them in the image area 
and retrace area, respectively, of a television signal: and 
an output unit for outputting the multiplexed television 
signal as an analog broadcast wave. With this structure, 
an analog broadcast wave can be utilized in realizing 
the interactive communication. 

The image data and control information stored in 
the first and second storing units may be digitized; and 
the transmitting unit may comprise: a reading unit for 
repeatedly reading a predetermined number of frames 
of image data together with corresponding control infor- 
mation from the first and second storing units: a multi- 
plexing unit for converting image data and control infor- 
mation into digital data streams, and then multiplexing 
the digital data streams so as to produce a multiplexed 
stream: and an output unit for outputting the multiplexed 
stream as a digital broadcast wave. 

With this structure, a digital broadcast wave can be 
utilized in realizing the interactive communication. 

The first and second storing units may store image 
data and corresponding control information as well as 
identifiers. The transmitting apparatus may further com- 
prise a third storing unit for storing audio data corre- 
sponding to the image data : with the same identifiers 
being allotted to the corresponding image data and con- 
trol information. Here, the transmitting unit may transmit 
the audio data as well as the image data. 

With this structure, sets of image data and audio 
data can be transmitted to achieve a more attractive in- 
teractive communication. 

The transmitting apparatus may comprise: an ob- 
taining unit for obtaining page information expressing a 
plurality of pages containing characters and images: a 
first producing unit for producing one frame of image da- 
ta containing characters and images in accordance with 
character information and image information included in 
the obtained page information: and a second producing 
unit for producing control information showing links be- 
tween frames by interpreting the link information includ- 
ed in the obtained page information. 

With this structure, page information obtained from 
outside can be converted into image data and control 
information suitable for broadcasting. 

The obtaining unit of the above transmitting appa- 
ratus can obtain page information from the World Wide 
Web on the Internet. 

The transmitting apparatus of this structure con- 
verts HTML documents of the WWW server on the In- 
ternet into image data and control information for broad- 
casting. By doing so. interactive broadcast programs 
which users can enjoy as if doing "Net surfing" on the 
Internet can be provided using a TV broadcast wave. 

In order to achieve the above object, the receiving 
apparatus should comprise: a separating unit for sepa- 
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rating a frame of image data and corresponding control 
information from the broadcast wave produced by mul- 
tiplexing a plurality of frames of image data and control 
information showing links between the plurality of 
5 frames of image data: a storing unit for storing the sep- 
arated image data and control information: a reproduc- 
ing unit for reproducing the stored image data to output 
an image signal: an operation unit for receiving an op- 
eration instruction to switch image data: and control unit 
10 for controlling the separatinq unit so as to separate an- 
other frame of image data designated by the control in- 
formation stored in the storing unit according to the op- 
eration instruction. 

The receiving apparatus having this structure re- 
15 ceives a broadcast wave from the transmitting appara- 
tus, and performs the processing of separating a frame 
of image data, reproducing it, and then outputs an image 
signal, according to the operation instruction. This re- 
ceiving apparatus can receive linked image data ex- 
20 pressed by the control information with certainty in the 
repetitive transmission, so that users can trace the de- 
sired linked image data successively. As a result, users 
can feel as if having a bidirectional communication using 
a one-way broadcast wave. With a conventional bidirec- 
25 tional server, the load greatly varies depending on the 
amount of request from the receiving apparatus, which 
have influence on the response time from receivinq an 
operation instruction until switching display images-. On 
the other hand, the load of the transmitting apparatus of 
30 the present invention does not vary so that the repetitive 
transmission cycle can be fixed. Thus, in the receiving 
apparatus of the present invention, image data can be 
switched within a predetermined response time, that is, 
within one cycle of the repetitive transmission. 
35 in this receiving apparatus, the identifier allotted to 

a frame of image data is the same as the identifier allot- 
ted to corresponding control information, and the control 
information expresses the identifier allotted to the linked 
image data. The separating unit of such a receiving ap- 
40 paratus may comprise a first detecting unit for detecting 
the identifier allotted to the image data, a second detect- 
ing unit for detecting the identifier allotted to the control 
information, and an obtaining unit for obtaining the im- 
age data and control information if the first and second 
45 detecting units have detected the identifiers. The storing 
unit of this receiving apparatus stores the image data 
and control information obtained by the obtaining unit. 

To this receiving apparatus, image data and control 
information are transmitted in the image area and re- 
so trace area, respectively, of a television signal as a mul- 
tiplexed analog broadcast wave. An identifier to be 
shown as an image at a fixed position in the non-dis- 
played part of the image area is transmitted in the broad- 
cast wave. The first detecting unit recognizes an identi- 
55 fier from the image at the fixed position in the non-dis- 
played part. 

The same identifier is allotted to image data and 
corresponding control information transmitted to this re- 




EP 0 810 789 A2 



20 



25 



3 



BNSDOCID: <EP 0810789A2_L> 



5 

ceiving apparatus. The image data and control informa- 
tion have been converted into digital data streams to be 
multiplexed to transmit a multiplexed stream as a mul- 
tiplexed digital broadcast wave. The digital data streams 
are allotted first identifying information to identify image 
data and second identifying information to identify con- 
trol information. The multiplexed stream is produced by 
multiplexing the digital data streams and a map table. 
The map table shows the correspondence between the 
first identifying information and image data identifiers as 
well as the corresponding between the second identify- 
ing information and control information identifiers. The 
storing unit of this receiving apparatus stores a map ta- 
ble separated by the separating unit. The control unit of 
this receiving apparatus recognizes an identifier allotted 
to linked image data expressed by control information, 
converts the identifier into first identifying information 
and second identifying information referring to the map 
table, and sets the first identifying information and sec- 
ond identifying information to the separating unit. The 
separating unit comprises a first detecting unit for de- 
tecting the first identifying information from the multi- 
plexed stream, a second detecting unit for detecting the 
second identifying information from the multiplexed 
stream, and an obtaining unit for obtaining image data 
and control information indicated by the first and second 
identifying information detected by the first and second 
detecting units. 

The control information may express at least one 
combination of a coordinate showing the image part of 
the corresponding image data and the identifier allotted 
to the linked image data. The operation unit of this re- 
ceiving apparatus receives an operation instruction to 
designate the image region in the image data. The con- 
trol unit of this receiving apparatus read the identifier 
allotted to the linked image data corresponding to the 
designated image region, and sets the identifier to the 
separating unit. 

The separating unit may further separate audio da- 
ta, the storing unit stores the separated audio data, and 
the reproducing unit reproduces the stored audio data 
to output an audio signal. 

With this structure, sets of image data and corre- 
sponding audio data are received and reproduced, so 
that more attractive interactive communication can be 
realized. 

In order to achieve the above object of the present 
invention, a receiving method should comprise the steps 
of: separating a frame of image data and corresponding 
control information from the broadcast wave produced 
by multiplexing a plurality of frames of image data and 
control information showing links between the plurality 
of frames of image data: storing the separated image 
data and corresponding control information: reproduc- 
ing the image data stored in a memory to output an im- 
age signal: receiving an operation instruction to switch 
image data: detecting image data indicated by the con- 
trol information stored in a memory according to the op- 
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eration instruction: and separating the detected image 
data and corresponding control information from the 
broadcast wave. 

A communication system which can achieve the 
5 above object should comprise the above-mentioned 
transmitting apparatus and the receiving apparatus. 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 These and otner objects, advantages and features 
of the invention will become apparent from the following 
description thereof taken in conjunction with the accom- 
panying drawings which illustrate a specific embodi- 
ment of the invention. In the drawings: 
1 5 FIG. 1 is a block diagram showing the structure of 

a data communication system 100 of the first embodi- 
ment of the present invention. 

FIG. 2 shows an example file list 200 stored in a file 
list storing unit 1 21 . 
20 FIG. 3 shows the HTML document 301 "Report, 

html" which is the first page of a home page provided 
by a WWW server. 

FIG. 4 shows the image information 401 "Weather, 
gif" which is an image displayed on the first page of the 
25 home page. 

FIG. 5 shows the HTML document 501 "Tokyo.html" 
which is the second page of the home page. 

FIG. 6 shows the HTML document 601 "Osaka, 
html" which is the third page of the home page. 
30 FIG. 7 shows an example of the link information ta- 

ble 700 stored in the data conversion table storing unit 
122. 

FIGs. 8A to 8C show transmission data 800 for the 
first page of the WWW home page generated from the 
35 HTML document 301, audio information "Weather.au", 
and the image information 401 . 

FIGs. 9A and 9B show transmission data 900 for 
the second page of the WWW home page generated 
from the HTML document 501 . 
-to FIGs. 10A and 10B show transmission data 1000 

for the third page of the WWW document generated 
from the HTML document 601 . 

FIG. 1 1 A shows a method for transmitting transmis- 
sion data by a transmitting unit 116. 
■ts FIG. 11 B shows a multiplexed stream transmitted 

in digital satellite broadcasting. 

FIG. 12 is a flowchart showing an overview of the 
procedure of the data transmitting apparatus 110. 

FIG. 1 3 is a flowchart showing an example informa- 
50 Won obtaining procedure of the information obtaining 
unit 111. 

FIG. 14 is a flowchart showing an example proce- 
dure for generating transmission data by the transmis- 
sion data generating unit 112. 
55 FIG. 15 is a flowchart showing a detailed example 

of the processing in step S1312 of FIG. 14. 

FIG. 1 6 shows an example of the cursor design cor- 
respondence table which the control unit 1 55 generates 
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to control the display position of the cursor design. 

FIG. 17 shows an example of the design information 
stored by the control unit 155. 

FIG. 18 shows the display image 1800 which is the 
initial screen displayed by the display unit 1 54 based on 
the transmission data 800 shown in FIGs. 8A to 8C. 

FIG. 1 9 shows the display image 1 900 which is the 
initial screen displayed by the display unit 1 55 based on 
the transmission data 900 shown in FIGs. 9A and 9B. 

FIG. 20 shows the display image 2000 which is the 
initial screen displayed on the display unit 154 for the 
transmission data 1000 shown in FIGs. 10A and 10B. 

FIG. 21 is a flowchart showing an example proce- 
dure for display control which is performed by the control 
unit 155. 

FIG". 22 is a block diagram showing the structure of 
a data communication system 2200 of the second em- 
bodiment of the present invention. 

FIG. 23 shows an example of the image information 
2301 "CM0001.BMP" which the second obtaining unit 
221 2 fetches from the second external database 2222. 

FIGs. 24A to 24C show an example of transmission 
data generated by the transmission data generating unit 
2213. 

FIG. 25 shows the initial display image displayed on 
the display unit 154 based on the transmission data 
2400 shown in FIG. 24. 

FIG. 26 is a flowchart showing an example proce- 
dure for generating transmission data by the transmis- 
sion data generating unit 2213. 

FIG. 27 is a block diagram showing the structure of 
the data communication system 2700 of the third em- 
bodiment of the present invention. 

FIGs. 23A to 28C show the transmission data 2800 
generated by the first data transmitting apparatus 2710 
based on the HTML document 301 shown in FIG. 3 : the 
audio information "Weather.au", and the image informa- 
tion 410 shown in FIG. 4. 

FIG. 29 shows the transmission data 2900 transmit- 
ted from the second data transmission apparatus 2720. 

FIG. 30 shows a further example of the structure of 
a data communication system. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

First Embodiment 

Fig. 1 is a block diagram showing the construction 
of the data communication system 100 which is de- 
scribed in the present embodiment. This data commu- 
nication system 100 is composed of a data transmitting 
apparatus 110 and a plurality of data receiving appara- 
tuses 150. 

The data transmitting apparatus 1 1 0 includes an in- 
formation obtaining unit 111 , a transmission data gen- 
erating unit 1 1 2, a transmission data holding unit 1 1 3, a 
transmission data reading unit 114, a multiplexing unit 



115. and a transmitting unit 116. 

Each data receiving apparatus 150 includes a sep- 
arating unit 151, a received data holding unit 152. a re- 
producing unit 1 53, a display unit 1 54, a control unit 1 55, 
5 a signal receiving unit 1 56. and an audio output unit 1 57. 

Construction of the Information Obtaining Unit 111 

The information obtaining unit 1 1 1 includes a file list 

io storing unit 1 21 and a buffer (not-illustrated) which holds 
information obtained from an external database : such 
as a WWW server. The file list storing unit 121 stores a 
file list 200 in which the file names of files that are to be 
obtained by the information obtaining unit 111 and the 

is addresses of these files are stored corresponding to se- 
rial numbers which show the order in which the files are 
to be obtained. 

Fig. 2 shows an example of the file list 200 stored in 
the file list storing unit 1 21 . In the file names given in this 

20 list, the extension "html" indicates that a file is an HTML 
document, the extension "gif" indicates that a file is an 
image which has been compressed according to GIF 
(Graphics Interchange Format), and the extension "au" 
indicates that a file is audio information in AU format. 

25 This file list 200 shown in Fig. 2 shows the case 

when the information obtaining unit 111 is connected to 
the Internet and obtains information from WWW serv- 
ers. In this example, the file list 200 is a table in which 
the URL (Uniform Resource Locator) of a directory on 

30 a WWW server is stored in the address column 202 cor- 
responding to each number in the serial number column 
201 . In the present example, each page in a home page 
provided by a WWW server can be composed of an 
HTML document and image files and audio files whose 

35 file names are indicated by the HTML document. As a 
result, the file name of the HTML document for each 
page is grouped together with the file names of the ac- 
companying image information files and audio files in 
the file name column 203 of the file list 200. 

-to it should be noted that there can be cases when the 

address and file names stored in file list storing unit 121 
for each serial number in the file list do not need to be 
recorded separately, so that they may instead be repre- 
sented using a single URL. It is also possible for files to 

45 be obtained not from a WWW server, but from an exter- 
nal database. In this case, the address of the file is ex- 
pressed as the address of a device in the external da- 
tabase and the file is expressed by a file address in the 
database. 

50 The information obtaining unit 1 1 1 reads a URL and 
the file names which are to be obtained from the URL 
from the file list storing unit 121 in ascending order of 
the serial numbers in column 201. It then accesses the 
WWW server indicated by the URL to obtain the indicat- 
es ed files. The information obtaining unit 111 assigns file 
names to the obtained files and stores the files in the 
buffer. 
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Examples of files 

The files obtained by the information obtaining unit 
111 are described below, with reference to Figs. 3. 4, 5 : 
and 6. 5 

Fig. 3 shows the HTML document 301 "Report.html" 
which is the first page of a home page provided by a 
WWW server. The notation 'HTML document 301 "Re- 
port. html"' indicates the file of HTML document 301 
whose file name is "Report.html." 10 

In HTML documents : character strings written in- 
side "<>" brackets are called tags. These tags represent 
control codes and are used in pairs written as "<char- 
acter string>" and "</character string>". The control 
codes in tags indicate the execution of a corresponding is 
control operation. 

Tags "<HTML>" on line 311 and "</HTML>" on tine 
323 in Fig. 3 indicate that the character strings between 
these tags form a single HTML document 301 . 

Tags "<H1>" and "</H1>" on line 312 indicate that 20 
the character string "WEATHER REPORT" between 
these tags is the headline of this document. 

Tags "<CENTER>" on line 313 and "</CENTER>" 
on line 315 indicate that the part of the document ex- 
pressed by the character strings between these tags 25 
should be centered. 

'<IMG SRC="Weather.gifV on line 314 indicates 
that the image information 401 "Weather.gif" shown in 
Fig. 4 is to be displayed in the document. Here, "SRC=" 
is an attribute of tag "<IMG>" and indicates an image 30 
information file. The attribute content of "SRC-" is 
"Weather.gif", indicating a file name. 

Fig. 4 shows the image information 401 "Weather, 
gif" which is an image displayed on the first page of the 
home page. 35 

As shown in Fig. 4, the image information 401 stored 
in image information file "Weather.gif" is a map of Japan 
which includes weather information. 

Tags "<P>" on line 316 and "</P>" on line 317 indi- 
cate that the character string "TOMORROW, THE 40 
WHOLE OF JAPAN WILL ENJOY SPRINGLIKE 
WEATHER" between these tags is a single paragraph. 

Tags "<UL>" on line 318 and "</UL>" on line 322 
indicate that the display items expressed by the charac- 
ter strings between these tags are displayed as an item- 45 
ized list without serial numbers. 

Each of the tags "<L1>" on lines 319 and 320 indi- 
cates that the character string between this tag and the 
next "<L1 >" or "</UL>" forms an item in the itemized list. 

'<A HREF="Tokyo.htm1 "> TOKYO </A>' on line 31 9 so 
of Fig. 3 indicates that the character string "TOKYO" is 
linked to the HTML document 501 "Tokyo.html" which is 
shown in Fig. 5. Here, character strings or images which 
are linked to other files, such as this character string 
"TOKYO", are called hot spots or anchor points. As one 55 
example, if a user uses the mouse to select the hot spot 
"TOKYO" which displayed on a computer monitor by a 
browser, the HTML document 501 "Tokyo. html" will be 
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read by the browser and is displayed on the screen. 
Here, the attribute of tag "<A>" : "HREF='\ represents a 
link destination, and the attribute content of "HREF=", 
in this case "Tokyo.html".. indicates a file name for the 
link destination file. 

'<A HREF="Osaka.html"> OSAKA </A>' on line 320 
of Fig. 3 indicates that the character string "OSAKA" is 
linked to the HTML document 601 "Osaka.html" which 
is shown in Fig. 6. Accordingly, this character string "OS- 
AKA" is also a hot spot. If hot spot "OSAKA" is selected, 
HTML document 601 "Osaka.html" will be displayed on 
the screen. 

'<A HREF="Weather.au"> AUDIO INFORMATION 
</A>' on line 321 of Fig. 3 indicates that the character 
string "AUDIO INFORMATION" is linked to the audio file 
"Weather.au. ", making it another hot spot. If the hot spot 
"AUDIO INFORMATION" is selected, the audio file 
"Weather.au." will be reproduced. 

Fig. 5 shows the HTML document 501 "Tokyo.html" 
which is the second page of the home page. The tags 
included in the HTML document 501 have already been 
explained, so that the followinq explanation will only deal 
with the links to other pages. * 

'<A HREF="Report.html"> RETURN </A>' on line 
511 of Fig. 5 indicates that the character string "RE- 
TURN" is linked to the HTML document 301 "Report, 
html" which is shown in Fig. 3. 

Fig. 6 shows the HTML document 601 "Osaka.html" 
which is the third page of the home page. 

'<A HREF="Report.html"> RETURN </A>' on line 
611 of Fig. 6 indicates that the character string "RE- 
TURN" is linked to the HTML document 301 "Report, 
html" which is shown in Fig. 3. 

The information obtaining unit 1 1 1 may obtain all the 
files listed in the file list 200 in order and store all of the 
obtained files in its buffer. Alternatively, the information 
obtaining unit 111 may obtain the listed files in units of 
one page and store the obtained files in the buffer. In 
this latter case, the files for a next page are only obtained 
after the processing of a current page has been com- 
pleted by the transmission data generating unit 112. 

Construction of Transmission Data Generating Unit 1 1 2 

The transmission data generating unit 112 includes 
a data conversion table storing unit 122 and a storage 
area (not shown in the drawings) which is used as the 
work area for generating transmission data. The data 
conversion table storing unit 122 includes a tag table, 
font files, and a link information table. The tag table is a 
list of control operations for every available HTML tag 
which each has its own flag. The font files each include 
character fonts for TV display which are classified for 
different purposes. The link information table is a table 
which expresses the link information for hot spots in a 
format recognized by the data communication system 
100. The work area is composed of a file storage area, 
a tag storage area, a character string storage area, and 
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a flag storage area. The file storage area stores one 
HTML document file. The tag storage area stores the 
character strings which are written inside the "< >" 
brackets of each tag. The character string storage area 
stores character strings other than the ones between the 
d < >" brackets. The flag storage area is an area where 
flags which are used for controlling the generation of dis- 
play image information for one frame of image data are 
set. The character strings stored in the tag storage area 
and the character string storage area are deleted when 
the control operations corresponding to the tags (flags) 
have been completed. If a plurality of flags are present 
in the flag storage area : the flags are set in ascending 
order and are reset in descending order. 

Fig. 7 shows an example of the link information table 
700 stored in the data conversion table storing unit 1 22, 
where the numbers, such as "9", are decimal values. 

As shown in Fig.7 : the link information stored in the 
link information table 700 is composed of index informa- 
tion 701 and hot spot information 702. 

Index information 701 is composed of an informa- 
tion identification part "INDEX=" for identifying the infor- 
mation as index information and a file identification 
number expressed as a four-figure decimal value. This 
file identification number is the identification number of 
a transmission data file which includes the current piece 
of index information 701 . 

Hot spot information 702 is composed of an infor- 
mation identification part "HOTSPOT=" for identifying 
the information as hot spot information.. X-Y coordinates 
"X=999.Y=999" : for indicating a cursor position in the 
current display screen, an instruction "GO TO PAGE" 
which corresponds to the cursor position given by these 
coordinates, and a four-figure decimal variable showing 
the identification number of the transmission file linked 
to this cursor position. 

The transmission data generating unit 112 treats 
one set of the display image information to be generated 
along with the accompanying audio information and link 
information as a single transmission data file : based on 
one HTML document. Here, the transmission data gen- 
erating unit 112 establishes a storage area in each of 
the display image information storing unit 1 23, the audio 
information storing unit 124, and the link information 
storing unit 125 which are provided in the transmission 
data holding unit 1 1 3 (described later) so that the display 
image information, audio information, and link informa- 
tion to be included in one transmission data file are in- 
terrelatedly stored. Hereinafter, the storage areas in the 
display image information storing unit 123, the audio in- 
formation storing unit 124, and the link information stor- 
ing unit 125 are respectively called the display image 
information storage area, the audio information storage 
area, and the link information storage area. 

The transmission data generating unit 112 assigns 
a same identification number to the display image infor- 
mation storage area, the audio information storage ar- 
ea, and the link information storage area used for storing 
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the corresponding kinds of information in a same trans- 
mission data file. Here, the transmission data generat- 
ing unit 1 1 2 manages the audio information and link in- 
formation in a same transmission data file as separate 
5 files which are given the same identification number. 
This identification number may correspond to the serial 
number in column 201 of the file list, which in turn cor- 
responds to the file names of the present files which are 
given in column 203. 
10 The transmission data generating unit 112 fetches 
an unprocessed HTML document file which has been 
obtained by information obtaining unit 111 from the buff- 
er in the information obtaining unit 111 in accordance 
with the serial number 201 in the file list 200. The trans- 
it mission data generating unit 1 1 2 then writes the file into 
the file storage area of the work area, in addition to gen- 
erating the index information in accordance with the for- 
mat of the index information 701 of the link information 
table 700. This generated index information is then 
stored at the front of the link information storage area in 
the transmission data holding unit 1 1 3. 

The transmission data generating unit 1 1 2 reads the 
tags in order from the start of the HTML document and 
interprets the tags by looking each tag up in the tag table 
to find the corresponding control operations. This inter- 
pretation of control operation is performed by writing a 
character string detected after a tag start sign "<" one 
character at a time into the tag storage area provided in 
the work area until a tag end sign ">" is detected. The 
transmission data generating unit 112 then matches the 
character string in the tag storage area with a tag written 
in the tag table. 

For tags which are not "<A>", "<IMG>". or '^char- 
acter string preceded by 7*>", the transmission data gen- 
erating unit 1 1 2 sets a flag showing the interpreted con- 
trol operation in the flag storage area provided in the 
work area and stores the character strings between the 
start tag "<>" and the corresponding end tag "</>" into 
the character string storage area in the work area so as 
to correspond to the set flag. The storage of character 
strings between a pair of corresponding tags is per- 
formed in the same way as the storage of the character 
strings included inside the tags themselves. The trans- 
mission data generating unit 1 1 2 converts the character 
strings in the character string storage area into text im- 
age using the fonts in one of the font files and arranges 
the text image in accordance with the control operation 
represented by the current flag to generate display im- 
age information. This generated display image informa- 
tion is then added to the display image information stor- 
age area provided in the transmission data holding unit 
113. Here, when a start tag "<character string>" is fol- 
lowed, not by a character string, but by another start tag 
"onother character string>", a flag is first set for the 
former tag in the flag storage area, before the process- 
ing is performed for the control operation indicated by 
the latter tag. 

If the read tag is "<IMG>\ the transmission data 
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generating unit 112 fetches the image information file 
with the file name specified by the attribute "SRC=" from 
the buffer of the information obtaining unit 1 1 1 , and de- 
compresses the image information file under the format 
specified by the file name extension to convert the for- 
mat of the image into an appropriate image data format, 
such as bitmap data or graphics data. 

If : for example, the file name extension is ".gif", the 
transmission data generating unit 112 decompresses 
the image information file under GIF to convert the im- 
age information file into the appropriate format. If a pre- 
ceding flag is set for a control operation to be performed 
on the converted image, the converted image is ar- 
ranged in accordance with this control operation to gen- 
erate display image information, otherwise the display 
image information is generated with the converted im- 
age being arranged in accordance with an initial setting. 
This generated display image information is then added 
to the display image information storage area. 

If the read tag is "<A>" : the transmission data gen- 
erating unit 1 1 2 checks to see if the "link destination file" 
specified by attribute "HREF-" of "<A>" is an audio file 
which has a file name extension, such as "au'\ which 
indicates audio information. If the link destination file is 
an audio file, the transmission data generating unit 112 
fetches the audio file from the buffer of the information 
obtaining unit 111 and converts the audio information 
into audiodata of a predetermined format, before storing 
it in the audio information storage area. 

If the link destination file is not an audio file, the trans- 
mission data generating unit 1 1 2 generates a text image 
for the character string between tags <A> and </A>, and 
arranges the text image at a display position indicated by 
a preceding flag, or alternatively at a display position 
specified by an initial setting, with a space being reserved 
for displaying a cursor. By doing so, the transmission data 
generating unit 112 generates display image information 
which is then added to the display image information stor- 
age area provided in the transmission data holding unit 
1 1 3. The transmission data generating unit 112 then cal- 
culates the X-Y coordinates for the space reserved for 
the cursor display position and refers to the hot spot in- 
formation 702 in the link information table 700 to generate 
hot spot information from the calculated X-Y coordinates 
and the "link destination file name" specified by the at- 
tribute "HREF^* of tag "<A>". In doing so. the transmis- 
sion data generating unit 1 1 2 refers to the file list 200 and 
finds the serial number 201 corresponding to the file 
name in column 203 which in turn corresponds to the link 
destination file name of tag "<A>", before writing this se- 
rial number 201 into the hot spot information as the file 
identification number. If the link destination file name is 
not present in the file list 200, the transmission data gen- 
erating unit 1 1 2 writes the file name of the current file into 
the hot spot information. After doing so, the transmission 
data generating unit 112 adds the generated hot spot in- 
formation to the link information storage area provided in 
the transmission data holding unit 113. 



After completing all the above processes for an 
HTML document, the transmission data generating unit 
112 writes a graphic representation of the identification 
number of the display image information area at a pre- 

5 determined position in the non-displayed area of the dis- 
play image information stored in the display image in- 
formation area. In the present embodiment, the identifi- 
cation number has been described as being a four-fig- 
ure decimal value, although the number of decimal digits 

10 js not limited to four. The identification number may al- 
ternatively be represented in binary notation, as a com- 
bination of numerals, characters and symbols, as a 
graphical figure, as a bar code, or even as a file name. 
Here, the audio information stored in the audio informa- 

15 tion storage area and the link information stored in the 
link information storage area are also appended with the 
identification numbers of the corresponding storage ar- 
eas, in the same way as with standard digital data files. 
Through the processes described above, the trans- 

20 mission data generating unit 112 generates a first, sec- 
ond, and third page of transmission data 800, 900, and 
1000, which are respectively the first, second, and third 
pages of the home page provided by the WWW server, 
from the HTML document 301 , the audio information not 

2$ shown in the drawings, the image information 401, the 
HTML document 501 , and the HTML document 601 . 

Transmission Data Generated by The Transmission 
Data Generating Unit 112 

30 

Figs.8A to 8C show the transmission data 800 that 
is the first page of the home page provided by the WWW 
server. This first page of transmission data 800 has been 
generated from the HTML document 301, the audio in- 

35 formation "Weather.au," and the image information 401 . 
Figs.9A and 9B show the transmission data 900 that is 
the second page of the home page provided by the 
WWW server which has been generated from the HTML 
document 501 . Figs. 10A and 10B show the third page 

40 of transmission data 1000 that is the third page of the 
home page which has been generated from the HTML 
document 601. As shown in Figs.8A to 8C, the trans- 
mission data 800 includes the display image information 

801 , the audio information 802, and the link information 
45 803 which is related to display image information 801. 

Here, Fig.8A shows the display image which is the con- 
tent of the display image information 801 . Fig.8B shows 
a representation of the content of the audio information 

802, and Fig.8C shows the content of the link informa- 
50 tion 803. 

In Fig.SA, the area surrounded by the dotted line 
above the display image information 801 is a non-dis- 
played area which is provided in each set of display im- 
age information. As its name suggests, this non-dis- 
55 played area is not displayed on the screen of the display 
unit 1 54. An image of an identification number, such as 
"0001 " shown in the drawing, is written into the top-right 
corner of the non-displayed area by the transmission da- 
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ta generating unit 1 1 2. The displayed area of display im- 
age information 301 is one display image which is com- 
posed of an image which was originally expressed as 
image information and character strings which have 
been converted from the original character code files in- 
to images. 

The audio information 802 is linked to the character 
string "AUDIO INFORMATION" which is a hot spot in 
the HTML document 301. Here, the file which includes 
the audio information 302 is also given the identification 
number "0001". as shown in Fig.8B. 

The file storing the link information 803 is also given 
the identification number "0001". as shown in Fig. SC. 
This link information 803 is used for control purposes, 
and is not displayed. "<INDEX=0001 >" on line 311 of 
the link information 803 is the index information which 
indicates that the file identification number of the trans- 
mission data 800 is "0001". 

The character string on line 812 indicates that in- 
struction "GO TO PAGE(0002)" is related to a position 
in display image information 801 which is specified by 
the coordinates (100,600) and that a cursor image held 
by the data receiving apparatus 1 50 should be displayed 
at this position. Instruction "GO TO PAGE(0002)" indi- 
cates that a page having identification number "0002", 
which in this case corresponds to the transmission data 
900, should be displayed. 

The character string on line 813 indicates that the 
instruction "GO TO PAGE(0003)" is related to a position 
in the display image information 301 specified by the co- 
ordinates (100,700) and that a cursor image held by the 
data receiving apparatus 1 50 should be displayed at this 
position. This instruction "GO TO PAGE(0003)" indi- 
cates that a page having identification number "OOOS", 
which in this case corresponds to the transmission data 
1000, should be displayed. 

Figs.9A and 9B show the transmission data 900 
which is the second page of the home page provided by 
the WWW server. This transmission data 900 includes 
the display image information 901 and the link informa- 
tion 902, which is related to the display image informa- 
tion 901. Here. Fig.9A shows the display image which 
is the content of the display image information 901 and 
Fig.9B shows the content of the link information 902. 

As shown in Fig.9A. an image of the identification 
number "0002" is written in the top-right corner of the 
non -displayed area of thedisplay image information 901 
which is shown by the dotted line, in the same way as 
with the display image information 801. 

As shown in Fig.9B. the file storing link information 
902 is given the identification number "0002". 

In Fig.9B, <1NDEX-0002> on line 911 is the index 
information, indicating that the file identification number 
for transmission data 900 is "0002". 

The character string on line 912 indicates that the 
instruction "GO TO PAGE(0001 )" is related to a position 
in the display image information 901 specified by coor- 
dinates (050,400) and that a cursor image held by the 
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data receiving apparatus 1 50 should be displayed at this 
position. This instruction "GO TO PAGE(0001)" indi- 
cates that a page having identification number "0001," 
which in this case corresponds to the transmission data 
5 800, should be displayed. 

Fig. 1 0A and 10B show the transmission data 1000 
which is the third page of the home page provided by 
the WWW server. Transmission data 1 000 includes dis- 
play image information 1001 and link information 1002, 
w which is related to display image information 1001. 
Here, Fig. 1 0A shows the display image which is the con- 
tent of the display image information 1001 and Fig. 1 0B 
shows the content of the link information 1002. 

As before, an image of the identification number 
15 "0003" is written into the top-right corner of the non-dis- 
played area of display image information 1001. 

As shown in Fig. 1 0B, the file storing link information 
1002 is given the identification number "0003". 

,, <INDEX=0003>" on line 1011 of the link informa- 
20 tion 1002 is the index information, indicating that the 
identification number of the files of the transmission data 
1000 is "0003". 

The character string on line 101 2 indicates that the 
instruction "GO TO PAGE(0001)" is related toa position 
25 in thedisplay image information 901 specified by the co- 
ordinates (050,400) and that a cursor image should be 
displayed at this position. This instruction "GO TO PAGE 
(0001)" indicates that a page having identification 
number "0001 ", which in this case corresponds to trans- 
30 mission data 800, should be displayed. 

Illustrative Example of the Processing by the 
Information Obtaining Unit 111 and the Transmission 
Data Generating Unit 112 

35 

The following is a specific example of the process- 
ing performed by the information obtaining unit 111. and 
the transmission data generating unit 112 in which the 
files shown in Figs. 3, 4, 5, and 6 are obtained and are 
-to used to generate the transmission data shown in Figs. 
8, 9 : and 10. 

Processing by the Information Obtaining Unit 111 

The information obtaining unit 111 first refers to the 
file list storing unit 121 and issues a connection request 
to the indicated WWW server on the Internet. The infor- 
mation obtaining unit 1 1 1 then obtains the HTML docu- 
ment 301 "Report. html" from this WWW server, assigns 
it the file name "Report. html", and stores the file in the 
buffer. The information obtaining unit 111 also obtains 
the compressed image information 401 , the HTML doc- 
ument 501, and the HTML document 601 in the same 
way from the WWW server 
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Processing by the Transmission Data Generating Unit 
112 

The transmission data generating unit 1 1 2 allocates 
storage areas in the transmission data holding unit 113 s 
for respectively storing the display image information 
801 , the audio information 802 : and the link information 
803 which compose the transmission data 800. In doing 
so t the transmission data generating unit 112 assigns 
the identification number "0001 " for retrieving transmis- to 
sion data 800 to these storage areas. The transmission 
data generating unit 112 then fetches the (yet-unproc- 
essed) HTML document 301 from the buffer of the infor- 
mation obtaining unit 111 and writes this document into 
the file storage area in the work area. is 

The transmission data generating unit 112 then 
generates the index information "<INDEX=0001 >" 
shown in line 811 of the transmission data 800 for the 
first page of the WWW home page from the file name 
"Report.html" of HTML document 301, before storing 20 
the generated index information at the start of the link 
information storage area for link information 803 which 
is provided in the transmission data holding unit 113. 

The transmission data generating unit 112 then 
reads the tag "<HTML>" from line 31 1 in the HTML doc- 25 
ument 301 and stores the character string "HTML" in the 
"<HTML>" tag in the tag storage area of the work area. 
It then refers to the tag table stored in the data conver- 
sion table storing unit 122 to interpret the tag, and by 
doing so recognizes that line 311 is the first line of the 30 
HTML document 301 . After doing so : it deletes the char- 
acter string "HTML" from the tag storage area. 

Next, the transmission data generating unit 112 
reads the tag "<H1>" on line 312 and refers to the tag 
table to interpret its content. On doing so ; it sets the 35 
headline flag in the flag storage area in the work area. 
Here, the headline flag shows that the character string 
following the "<H1 >" tag is a headline and so should be 
displayed using a headline font. The characters in the 
character string after the "<H 1 >" tag are then written one 40 
character at a time into the character string storage area 
until the "</H1 >" tag appears, which in the present case 
results in the character string "WEATHER REPORT" be- 
ing written into the character string storage area and be- 
ing converted into display image information using the 45 
headline font. This generated display image information 
is then added to the display image information storage 
area set in the transmission data holding unit 113. After 
this, the headline flag in the work area is reset, the char- 
acter string "WEATHER REPORT" is deleted from the so 
character string storage area, and the character string 
"H1 " is deleted from the tag storage area. 

Next, the transmission data generating unit 112 
reads the tag "<CENTER>" on line 31 3 and sets the ce- 
ntering flag in the work area. The centering flag shows S5 
that the character string which follows the correspond- 
ing tag is to be centered on the display. Here, there is 
no character string following the "<CENTER> H tag which 
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can be centered, so that the transmission data generat- 
ing unit 112 continues by reading line 314. 

The transmission data generating unit 1 1 2 reads the 
tag '<IMG SRC="Weather.gif">' on line 314 and refers 
to the tag table to interpret the content of the tag. The 
transmission data generating unit 1 1 2 then investigates 
whether the file for the image information 401, which is 
expressed by the file name "Weather.gif", is present in 
the buffer of the information obtaining unit 111. ^nd, 
since this is the case, reads the file. The transmission 
data generating unit 112 then converts the image infor- 
mation 401 which is stored and compressed in the read 
file into a bitmap image or other such format, in accord- 
ance with a GIF decompression method. 

The transmission data generating unit 112 then 
reads the tag "</CENTER>" on line 315 and arranges 
the bitmap image converted from image information 401 
in accordance with the centering flag set in the work ar- 
ea. The display image information thus generated is 
then added to the display image information storage ar- 
ea in the transmission data holding unit 113, before the 
centering flag in the work area is reset. 

The transmission data generating unit 112 then 
reads the "<P>" tag on line 31 6 and sets the paragraph 
flag. The paragraph flag shows that the character strings 
displayed between this start tag and the "</P" end tag 
should be displayed as a single paragraph which is to 
be inserted into the following blank line. As with 
"WEATHER REPORT" on line 31 2, the character string 
"TOMORROW. THE WHOLE OF JAPAN WILL ENJOY 
SPRINGLIKE WEATHER" between these tags is read 
and is stored in the character string storage area in the 
work area. Next, after reading the "</P>" tag, the trans- 
mission data generating unit 1 1 2 converts the character 
string "TOMORROW, THE WHOLE OF JAPAN WILL 
ENJOY SPRINGLIKE WEATHER" into an image using 
the font for paragraph display which is stored as one of 
the font files and adds the generated display image in- 
formation to the storage area in the transmission data 
holding unit 113 for display image information storage 
area 801. After this, the content of the work area is 
cleared as before. 

The transmission data generating unit 112 next 
reads the tag "<UL>" on line 318, interprets it, and sets 
the itemized list flag in the work area. The itemized list 
flag shows that each character string which follows the 
tag and is interpreted as one item should be displayed 
as a non-numbered item in a list. 

The transmission data generating unit 112 next 
reads the tag "<L1 >" on line 31 9, refers to the tag table, 
interprets the tag as indicating the start of one item in a 
list, and sets the item flag in the flag storage area. The 
item flag shows that the display position on the display 
screen should be shifted to the next line every time an 
"<L1>" or "</L1>" tag is read. 

The transmission data generating unit 1 1 2 reads the 
tag "<A HREF="Tokyo.html>" following the tag "<L1>" 
and writes it into the tag storage area. The transmission 
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data generating unit 112 then interprets this tag °<A 
HREF="Tokyo.html>" and sets the link flag in the flag 
storage area. 

When the extension of the file name given as the 
attribute of the "<A>" tag indicates audio information, the 
link flag shows that processing for the audio information 
is to be performed so that the audio information is con- 
verted into a predetermined format and stored in the au- 
dio information storage area. When the extension of the 
file name given as the attribute of the "<A>" tag does 
not indicate audio information the link flag shows that 
the character string between the "<A>" and "</A>" tags 
which is appended with the link by the "<A>" tags is to 
be converted into an image with a two-character space 
provided before it as a cursor display area. The link flag 
also shows that display image information is to be gen- 
erated for this character string in addition to hot spot in- 
formation which is generated in accordance with the for- 
mat of the hot spot information 702. 

The transmission data generating unit 112 reads the 
character string "TOKYO" between the "<A HREF="To- 
kyo.html>" and "</A>" tags and writes it into the char- 
acter string storage area. After reading the "</A>" tag, 
the transmission data generating unit 112 converts the 
character string "TOKYO" into an image with a two-char- 
acter space provided before it as a cursor display area 
and arranges the character string in accordance with the 
itemized list flag to generate display image information 
which it adds to the display image information storage 
area provided in the transmission data holding unit 1 1 3. 
The transmission data generating unit 112 then calcu- 
lates the coordinates of the cursor display position as 
(1 00 : 600) : and uses these coordinates and the attribute 
"Tokyo.html" stored in the tag storage area of the work 
area to generate the hot spot information shown on line 
81 2 of Fig. 8. After doing so. the transmission data gen- 
erating unit 1 1 2 adds the generated hot spot information 
to the link information storage area provided in the trans- 
mission data holding unit 113. Having done so, the 
transmission data generating unit 1 1 2 deletes the char- 
acter string "AHREF="Tokyo.html" in the tag storage ar- 
ea of the work area and the character string "TOKYO" 
in the character string storage area, in addition to reset- 
ting the link flag. 

Next on reading the "<L1>" tag on line 320 : the 
transmission data generating unit 112 shifts the display 
position for the next display image to the following line 
in accordance with the item flag, and, in the same way 
as with line 319, generates display image information 
for the character string "OSAKA", in addition to gener- 
ating the hot spot information shown on line 81 3 of Fig. 
8C. The generated display image information is then 
added to the display image information storage area 
provided in the transmission data holding unit 113 and 
the generated hot spot information is added to the link 
information storage area. After this, the transmission da- 
ta generating unit 112 deletes the character string "A 
HREF="Osaka.html" and the character string "OSAKA", 



and resets the link flag. 

Next, on reading the "<L1>" tag on line 321, the 
transmission data generating unit 112 shifts the display 
position for the next display image to the following line 

s in accordance with the item flag, and sets the link flag 
in accordance with the tag "A HREF= M Weather.au M . On 
investigating the file name extension of the attribute in 
accordance with the link flag, the transmission data gen- 
erating unit 1 1 2 finds that the link destination file is audio 

io information in AU format, so that it converts the AU for- 
mat audio information into audio information of a prede- 
termined format, before storing the converted audio in- 
formation in the audio information storage area provided 
in the transmission data holding unit 113. 

is Next, on reading the "</L1>" tag on line 322, the 
transmission data generating unit 1 1 2 interprets that the 
itemized list is complete, and resets the itemized list flag 
and the item flag. 

Finally, on reading the "</HTML>" tag on line 323, 

20 the transmission data generating unit 1 1 2 interprets that 
the HTML document 301 has ended, and so terminates 
the generation process for transmission data 800. 

Following this, the transmission data generating 
unit 112 finds that there is an unprocessed HTML doc- 

25 ument 501 and so sets a display image information stor- 
age area for display image information 901 and a link 
information storage area for link information 902 in the 
transmission data holding unit 113 for storing the com- 
posite parts of the transmission data 900, in doing so 

30 giving both storage areas the identification number 
"0002" for the retrieval of the transmission data 900. It 
then reads the unprocessed HTML document 501 from 
the buffer of the information obtaining unit 1 1 1 and writes 
it into the work area. 

35 The transmission data generating unit 112 then 

generates the index information "<INDEX=0002>" 
shown in line 911 of the transmission data 900 which 
displays the second page of the WWW home page from 
the file name "Tokyo. html" of the HTML document 501, 

■to before storing the generated index information at the 
start of the link information storage area for the link in- 
formation 902 which is provided in the transmission data 
holding unit 113. In the same way as with the generation 
of the transmission data 800 from the HTML document 

-J5 301 and the image information 401 , the transmission da- 
ta generating unit 112 then generates the transmission 
data 900 from the HTML document 501 and the trans- 
mission data 1000 from the HTML document 601, with 
no further explanation of this process being given. 

50 

Construction of the Transmission Data Holding Unit 1 1 3, 
the Transmission Data Reading Unit 114, the 
Multiplexing Unit 115, and the Transmitting Unit 116 

55 The transmission data holding unit 113 includes a 
display image information storing unit 123, an audio in- 
formation storing unit 1 24, and a link information storing 
unit 1 25, with simultaneous retrieval from these units be- 
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ing possible. 

The display image information storing unit 123 can 
be realized by RAM (Random Access Memory) or a hard 
disk device, and is provided with a plurality of display 
image information storage areas which are set by the 
transmission data generating unit 112. Each of these 
display image information storage areas stores one file 
of display image information which is generated by the 
transmission data generating unit 112. 

The audio information storing unit 124 can also be 
realized by RAM (Random Access Memory) or a hard 
disk device, and is provided with a plurality of audio in- 
formation storage areas which are set by the transmis- 
sion data generating unit 112. Each of these audio in- 
formation storage areas stores one file of audio infor- 
mation which is generated by the transmission data gen- 
erating unit 112. 

The link information storing unit 1 25 can also be re- 
alized by RAM (Random Access Memory) or a hard disk 
device, and is provided with a plurality of link information 
storage areas which are set by the transmission data 
generating unit 112. Each of these link information stor- 
age areas stores one file of link information which is gen- 
erated by the transmission data generating unit 112. 

The transmission data reading unit 114 simultane- 
ously reads the display image information, the audio in- 
formation, and the link information in a same transmis- 
sion data file from the storage areas provided in the 
transmission data holding unit 1 1 3 in the order of the file 
identification numbers for the transmission data, and 
outputs the read information to the multiplexing unit 1 1 5. 
After reading the files for the transmission data which 
has the final identification number, the transmission data 
reading unit 114 returns to the transmission data with 
the identification number "0001" and once again reads 
the transmission data in the order of the identification 
numbers. This is to say, the transmission data reading 
unit 114 cyclically reads the transmission data from the 
transmission data holding unit 1 1 3 in order of identifica- 
tion numbers and outputs the transmission data to the 
multiplexing unit 115. In doing so, there is the following 
difference in the reading method when audio informa- 
tion is or is not present. When no audio information is 
present the transmission data reading unit 1 1 4 advanc- 
es to the reading of a set of transmission data with the 
next identification number after reading a first set of 
transmission data once. When audio information is 
present, the transmission data reading unit 114 reads 
the audio information and advances to the reading of a 
set of transmission data with the next identification 
number only after reading the display image information 
and the link information a plurality of times for the period 
which is required by the reproduction of the audio infor- 
mation. As one example, if the audio information has a 
reproduction period of two seconds, the transmission 
data reading unit 114 will read the audio information 
once, and will read the display image information and 
link information 60 times (30 frames per second * 2 sec- 
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onds), before advancing to the reading of a set trans- 
mission data with the next identification number. In this 
way, the transmission time for audio information can be 
maintained. 

5 The multiplexing unit 115multiplexes the display im- 

age information (including the audio information) and 
the link information read by the transmission data read- 
ing unit 114, and outputs multiplexed data to the trans- 
mitting unit 116. Here, this multiplexing can be per- 

io formed using the same method as conventional teletext 
broadcasting. In such a case, display image information 
and audio information are multiplexed in the same way 
as the images and audio included in conventional TV 
broadcasts, while link information is multiplexed in the 

is same way as the text information multiplexed with tele- 
text broadcasts. This is to say. when no audio informa- 
tion is present, the display image information is trans- 
mitted in the image section of one frame of the television 
image signal, while the link information is transmitted in 

20 the retrace section of the same one frame of the televi- 
sion image signal. When audio information is present, 
the audio information is transmitted as the television au- 
dio signal, while the corresponding display image infor- 
mation and link information are transmitted in the image 

25 area and retrace area, respectively of the television im- 
age signal for the number of frames required by the re- 
production of the audio information. 

The transmitting unit 1 1 6 successively transmits the 
transmission data which has been multiplexed by the 

30 multiplexing unit 115 on a TV broadcast ground wave. 

Transmission Method for the Transmission Data 

Fig. 1 1 A gives a graphic representation of the trans- 

35 mission method used by the transmitting unit 116. Fig. 
11 A shows the case when n pages (n being a positive 
integer) of transmission data are generated by the trans- 
mission data generating unit 112. In Fig. 1 1 A, a pairing 
of audio information and display image information with 

-io a same identification number is expressed as one trans- 
mission unit corresponding to a normal TV broadcast, 
and the link information for the same identification 
number is expressed as one transmission unit corre- 
sponding to the text information which is multiplexed into 

45 a standard teletext broadcast. 

As shown in Fig. 11 A, in addition to being identified 
by the same identification number, the display image in- 
formation, audio information, and link information stored 
in one transmission data file are transmitted at a corre- 

50 sponding time. Also, the transmission data from the first 
to the n th page in the transmission data holding unit 1 1 3 
are cyclically transmitted in the order of identification 
numbers. 

It should be noted here that while the transmission 
55 data reading unit 1 1 4 has been described as reading the 
display image information, the audio information, and 
the link information stored in the same transmission data 
file simultaneously from the display image information 
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storing unit 123 : the audio information storing unit 124. 
and the Jink information storing unit 125 and as having 
the read display image information, audio information, 
and link information transmitted with related identifica- 
tion numbers and transmission timing, the display image 
information and the link information do not need to be 
transmitted with a related timing. As one example, the 
transmission data reading unit 114 may instead be com- 
posed of a first reading unit and a second reading unit. 
Here : the first reading unit is constructed to continuously 
read pairs of display image information from the display 
image information storing unit 123 and audio informa- 
tion from the audio information storing unit 124 which it 
then outputs to the multiplexing unit 115. The second 
reading unit is constructed to continuously read only the 
link information from the link information storing unit 1 25 
which it then outputs to the multiplexing unit 115. By do- 
ing so, the display image information and link informa- 
tion belonging to a same transmission data file do not 
need to be transmitted by the transmitting unit 11 6 at the 
same time, since the data receiving apparatus 1 50 can 
use the identification number commonly given to the dis- 
play image information and the link information to re- 
combine pairs of the display image information and the 
link information. 

The multiplexing unit 115 has also been described 
as multiplexing the display image information (including 
the audio information) and the link information which are 
generated by the transmission data generating unit 112, 
with the transmitting unit 116 transmitting the transmis- 
sion data which has been multiplexed by the multiplex- 
ing unit 115 on a TV broadcast ground wave, although 
the display image information and link information do not 
need to be multiplexed together for transmission. As one 
example, the display image information and the audio 
information may be transmitted on a TV broadcast 
ground wave or as a digital satellite broadcast, while the 
link information may be transmitted using a telephone 
link and modem, or the like. Transmission here may al- 
ternatively be performed using multiple channels. 

When digital satellite broadcasting is used as the 
data transmission method, compression/encryption and 
multiplexing may be performed according to MPEG2 
(Moving Pictures Experts Group) video standard and 
system standard, so that display image information may 
be set as I pictures, with the audio information and link 
information being set as private information. Here, when 
it is possible for the display image information, audio in- 
formation, and link information to be transmitted as dig- 
ital data, it is no longer necessary to write a graphic rep- 
resentation of the identification number into the non-dis- 
played area of the display image information, so that the 
identification number can be simply appended to the dis- 
play image information and audio information, in the 
same way as with the link information. Incidentally, a de- 
tailed description of MPEG2 standard is given in "Sa- 
ishin MPEG Kyoukasho [Latest MPEG Reader]" pub- 
lished by ASCII Publishing, Inc. 



Fig. 11 B shows the multiplexed stream which is 
transmitted when digital satellite broadcasting is used. 
The upper part of this drawing shows a transport stream 
under MPEG2 standard which has been generated by 
5 the multiplexing unit 115. 

The symbols "V1, A1 : L1" in the transport stream 
represent the display image information audio informa- 
tion: and link information which have the identification 
number "0001" and which are read from the transmis- 
10 sion data file and multiplexed together. This is also the 
case for "V2, A2, L2" ... "Vn : An, Ln M . 

"V1 " is a video elementary stream which shows the 
display image information which has been converted in- 
to I (Intra) pictures under MPEG2 standard, with the PID 
1$ (Packet IDentifier) "0x0100" having been attached to 
identify the stream. This is also the case for "V2" ... "Vn". 

"A1" is an audio elementary stream which shows 
the audio information which has been converted under 
MPEG2 standard, with the PID "0x0101" having been 
20 attached to identify the stream. This is also the case for 
"A2" ... "An". 

"LI - Ln" are private sections according to MPEG2 
standard for attaching each set of link information, with 
the table ID "OxBO" having been attached to identify 

25 these as private sections. Here, identification numbers 
are also set in the table ID extensions to identify sepa- 
rate sets of link information. Each of these sets of link 
information is set at least one pairing of one part of the 
image area of the corresponding display image and in- 

30 formation showing a link to another display image. As 
one example, in "L1", the display area centered on the 
coordinates (X,Y)=( 100,600) is set the link "GOTO 
PAGE(0002) n representing a link to the display image 
with the identification number "0002", while the display 

35 area centered on the coordinates (X,Y)=(1 00,700) is set 
the link "GOTO_PAGE(0003)" representing a link to the 
display image with the identification number "0003". 

The correspondence between the PIDs described 
above and the identification numbers is set according to 

40 the PMT (Program Map Table) under MPEG2 standard.- 
Here, the correspondence between the PIDs and the 
identification numbers can be written in the descriptors 
of the PMT such as by setting the identification numbers 
as the component tags in the PMT as shown in Fig. 1 1 B. 

45 in the above case, the video elementary stream, au- 
dio elementary stream, and private sections are gener- 
ated by the transmission data generating unit 112 and 
are stored in the transmission data holding unit 113. 
Here, a set of one video elementary stream, one audio 

50 elementary stream, and one private section stored in the 
transmission data holding unit 113 corresponds to one 
transmission data file. Here, the video elementary 
stream, audio elementary stream, and private section 
stored as one set in the transmission data holding unit 

55 113 are each read once, with the transmission data 
reading unit 1 1 4 cyclically reading all of the transmission 
data files. Using this data, transport streams are gener- 
ated by the multiplexing unit 115. 
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As described above, by multiplexing n sets of dis- 
play image information, audio information, and link in- 
formation with a PMT in the transport stream, transmis- 
sion data can be easily transmitted using digital satellite 
broadcasting. 

Overview of the Procedure of the Data Transmitting 
Apparatus 110 

The following is a detailed explanation of the pro- 
cedure of the data transmitting apparatus 11 0 : with ref- 
erence to Figs. 12 to 14. 

Fig. 12 is a flowchart showing an overview of the 
procedure of the data transmitting apparatus 110. 

The information obtaining unit 1 1 1 obtains a desired 
set of information from an external database and stores 
it in its internal buffer (step S1 1 01 ). 

The transmission data generating unit 112 inter- 
prets the information obtained by the information obtain- 
ing unit 111 and generates display image information, 
audio information, and link information, which it stores 
in the transmission data holding unit 113 (step S1102). 

The transmission data reading unit 1 1 4 successive- 
ly reads the transmission data from the transmission da- 
ta holding unit 113 in order of identification numbers 
(step S1103). 

The multiplexing unit 1 15 multiplexes thedisplay im- 
age information (including the audio information) with 
the link information, and the transmitting unit 116 trans- 
mits the multiplexed transmission data using a television 
broadcast ground wave. 

Procedure of the Information Obtaining Unit 111 

Fig. 13 is a flowchart showing an example informa- 
tion obtaining procedure of the information obtaining 
unit 111. 

The information obtaining unit 111 first refers to the 
file list in the file list storing unit 1 21 and checks whether 
there is any as-yet-unobtained information (step 
S1201). If there is not, the information obtaining proce- 
dure is terminated. If there is, the file addresses (or 
URLs) of the as-yet-unobtained sets of information are 
fetched one at a time (step S1202). 

The information obtaining unit 111 then requests a 
connection with an external database, based on the 
fetched address (step S1203), and checks whether the 
connection has been successively established (step 
S1204). If the connection is unsuccessful, the process- 
ing returns to step S1203 (step S1204). 

If the connection has been successful, the informa- 
tion obtaining unit 111 reads the file names of the as- 
yet-unobtained information from the file list, obtains the 
corresponding files from the external database, and 
stores them in the internal buffer (step S1205). The 
processing then returns to step S1 201. 
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Procedure of the Transmission Data Generating Unit 
112 

Fig. 14 is a flowchart showing an example proce- 
s dure for generating transmission data by the transmis- 
sion data generating unit 112. 

The transmission data generating unit 112 first re- 
fers to the buffer in the information obtaining unit 111 
and checks whether any unprocessed HTML docu- 
ments exist (step S1301). If no such documents exist, 
the display image generating procedure is terminated. 
If there is such a document, the transmission data gen- 
erating unit 112 establishes the transmission data stor- 
age areas in the transmission data holding unit 113, as- 
signs an identification number to each transmission data 
storage area, and then fetches an unprocessed HTML 
document from the buffer (step S1 302). 

The transmission data generating unit 112 creates 
index information indicative of the file name of the trans- 
mission data from the file name of the fetched HTML 
document, and adds the index information to the link in- 
formation storage area established in the transmission 
data holding unit 113 (step S1303). 

One character is read from the fetched HTML doc- 
ument and is written into the character string storage 
area (step S1304). 

The transmission data generating unit 112 then 
checks whether the read character is a tag start sign "<" 
(step S1305). If so, the processing advances to step 
S1 307, or if not, the character is added to the character 
string storage area in the work area, and the processing 
returns to step S1 304 (step S1306). 

The next character is read (step S1307), and the 
transmission data generating unit 112 judges whether 
the read character is a tag end sign ">" (step S1308). If 
so, the processing advances to step S1 31 0, or if not, the 
read character is added to the tag storage area in the 
working area, before the processing returns to step 
S1307 (step S1309). 

The character string in the tag storage area is com- 
pared with the tag tabic, and a check is performed to 
see whether it starts with a 7" sign (step S1310). If it 
does, the transmission data generating unit 112 judges 
whether the read tag is a "</HTML>" tag (step S1311). 
If so, the transmission data generating unit 112 resets 
the work area, and the processing returns to step 
S1310. If the read tag is not "</HTML>", the transmis- 
sion data generating unit 112 operates in accordance 
with the least significant of the flags set in the flag stor- 
age area corresponding to this read tag, and resets the 
corresponding storage area in the work area (step 
S1 31 2), before the processing returns to step S1 304. 

In step S1 310, when the character string does not 
start with 7", a check is performed to see whether the 
read tag is "<IMG>" (step S1 31 3). If so, the transmission 
data generating unit 112 fetches the image information 
file specified by the attribute of the "<IMG>" tag from the 
buffer in the information obtaining unit 1 1 1 (step S1 31 4). 
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The fetched image information is converted in accord- 
ance with a GIF decompression method into image in- 
formation expressed as bitmap data (step S1315), and 
the processing returns to step S1 304. 

If the read tag is not "<IMG> n , the character string 
in the tag storage area is compared with the content of 
the tag table and a flag corresponding to the tag is set 
in the flag storage area. The transmission data gener- 
ating unit 112 then operates in accordance with this tag 
(step s1316), before the processing returns to step 
S1304. 

A variety of tags can be employed in the HTML doc- 
uments: and the processes represented by these tags 
can be performed in the same way as a conventional 
browser. Accordingly, the following explanation focuses 
on an example of the processing in step Si 312 for the 
tag "</A>" which relates to the link information which 
generated in a special format for this data communica- 
tion system 100. 

Fig. 1 5 is a flowchart showing a detailed example of 
the processing in step S 1 31 2 of Fig. 1 4. 

The transmission data generating unit 112 first 
checks whether the read tag is "<A>" (step S1 401 ), and 
if not, the processing advances to step S1408. 

If the read tag is "<A>" : the transmission data gen- 
erating unit 112 judges whether the link destination file 
specified by the attribute is an audio information file 
(step S1402). If it is, the processing advances to step 
S1407, or if not, the transmission data generating unit 
1 1 2 generates display image information for the charac- 
ter string established in the character string storage ar- 
ea, in doing so leaving a display area for displaying a 
cursor design, before adding the generated display im- 
age information tothe display image information storage 
area provided in the transmission data holding unit 113 
(step S1403). 

The transmission data generating unit 1 1 2 then cal- 
culates the X-Y coordinates which express the display 
position of the cursor design (step S1404). 

The transmission data generating unit 112 then 
generates hot spot information based on the calculated 
X-Y coordinates and the attribute established in the tag 
storage area : and adds it to the link information storage 
area provided in the transmission data holding unit 1 1 3 
(step S1405). 

The transmission data generating unit 112 then re- 
sets the link flag in the work area, and deletes the char- 
acter string in the tag storage area and the character- 
sequence storage area (step S1406). 

The transmission data generating unit 112 fetches 
an audio information file and converts the audio infor- 
mation contained in the file into information of a prede- 
termined format which it stores in the audio information 
storage area (step S1407). 

The transmission data generating unit 1 1 2 operates 
in accordance with the read tag (step S1408). 



Structure of the Data Receiving Apparatus 150 

The following is an explanation of the components 
of the data receiving apparatus 150, with reference to 
5 Figs.16to20. 

Structure of the Separating Unit 151 

The separating unit 151 includes a read buffer 161 
10 for reading the identification number allotted to trans- 
mission data. The read buffer 161 has storage areas for 
temporarily holding the display image information (in- 
cluding audio information) included in one transmission 
file and the link information included in one transmission 
is file. 

The separating unit 151 separates display image in- 
formation (including audio information) and link informa- 
tion from the received transmission data, and stores the 
separated display image information and link informa- 

20 tion in the corresponding storage areas of the read buff- 
er 161. The identification number assigned to the dis- 
play image information stored in the storage area is read 
by recognizing the image written in the predetermined 
part of the non-displayed area of the display image in- 

25 formation. The identification number assigned to the link 
information is read in the same manner as when reading 
an identification number assigned to a conventional dig- 
ital data file. If the read identification number is the iden- 
tification number designated by the control unit 155 : 4he 

30 display image information (including audio information) 
or the link information held by the read buffer 161 is 
stored in the corresponding storage area in the received 
data holding unit 152. At this point, any audio informa- 
tion which is present is stored by the separating unit 1 51 

05 in a corresponding storage area provided in the received 
data holding unit 152 at the same time as the display 
image information is stored, so that the audio informa- 
tion is gradually accumulated while the display image 
information with the identification number designated by 

-to the control unit 155 is repetitively transmitted. By doing 
so, audio information which is transmitted across a plu- 
rality of frames can be separated from the transmission 
data. 

If the read identification number is not the identifi- 
es cation number designated by the control unit 155, the 
display image information (including audio information) 
or its link information held by the read buffer 161 is dis- 
carded. The reading of new display image information 
(including audio information) and link information is con- 
50 tinued, and the above procedure is repeated until the 
identification number designated by the control unit 1 55 
is detected. 

Structures of the Received Data Holding Unit 152, the 
55 Reproducing Unit 153, and the Display Unit 154 

The received data holding unit 1 52 stores display 
image information (including audio information) and link 
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information separated by the separating unit 151 linked 
with their assigned identification number. The storage 
area for storing the display image information can be 
achieved by RAM or a hard disk device capable of stor- 
ing one static image which is the size of the display 
screen. 

The reproducing unit 153 reproduces the display 
image information stored in the received image holding 
unit 152 along with the graphics information (described 
later) inputted from the control unit 155, in accordance 
with an indication which it receives from the control unit 
155. The reproducing unit 153 outputs the reproduced 
image to the display unit 1 54. The reproducing unit 1 53 
also reproduces the stored audio information in syn- 
chronization with the reproduction display image infor- 
mation and outputs the reproduced audio to the audio 
output unit 157. 

The display unit 154 can be realized by a television 
monitor which displays images according to NTSC (Na- 
tional Television System Committee) standard, and is 
used to display the display image and cursor design on 
its screen, in accordance with the input from the repro- 
ducing unit 1 53. 

Structure of the Control Unit 155 

The control unit 155 sets an initial value in the reg- 
ister storing a variable (described later), and instructs 
the separating unit 151 to fetch the display image infor- 
mation (including audio information) and link information 
of a page specified by this initial value, which as one 
example can be the identification number "0001 ". 

The control unit 155 instructs the reproducing unit 
1 53 to reproduce the display image information (includ- 
ing audio information), every time new display image in- 
formation (including audio information) is stored in the 
received data holding unit 152. Every time new link in- 
formation is stored in the received data holding unit 1 52, 
the control unit 155 interprets the link information and 
generates a cursor design correspondence table in 
which cursor designs (described later) are generated for 
each cursor display position. These cursor designs are 
expressed by cursor information which is held inside the 
control unit 155. The control unit 155 outputs design in- 
formation expressing a cursor design together with the 
cursor position to the reproducing unit 153, as well as 
indicating the reproduction of the cursor design. 

Fig. 16 shows an example of the cursor design cor- 
respondence table which the control unit 1 55 generates 
to control the display position of the cursor design. 

The cursor design correspondence table shows the 
correspondence between each cursor display position 
which is expressed in the hot spot information in the link 
information stored in the received data holding unit 1 52 
and the cursor number for the cursor design to be dis- 
played at each cursor display position. The control unit 
155 assigns cursor numbers to each cursor display po- 
sition in the link information in order of lowest Y coordi- 
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nate and then lowest X coordinate, as one example, and 
writes each display position into the item with corre- 
sponding cursor number in the cursor design corre- 
spondence table. 

s Fig. 1 7 shows an example of the design information 

stored by the control unit 155. As shown in Fig. 17, the 
control unit 155 stores cursor information which ex- 
presses a cursor design for each cursor number when 
the number is selected (referred to as the "selection 

10 state") and a cursor design for each number when the 
number is not selected (referred to as the "non-selection 
state"). 

On receiving an interrupt from the signal receiving 
unit 1 56, the control unit 1 55 interprets the type of input 

75 signal stored in the signal receiving unit 1 56, selects the 
design information of the corresponding cursor design, 
and outputs the cursor information to the reproducing 
unit 1 53. Following this, the control unit 1 55 controls the 
handling of the received data by the separating unit 1 51 , 

20 in accordance with the cursor whose selection has been 
confirmed. 

Display Control Procedure for the Received Data 

25 The following is a detailed explanation of the display 

control procedure by the control unit 1 55 for a set of re- 
ceived data, a set of received data referring to display 
image information (including audio information) and link 
information which have been stored in corresponding 

30 storage areas in the received data holding unit 152 by 
the separating unit 151 and which have the same iden- 
tification number. 

The control unit 155 sets a predetermined value, 
such as "1 ", into the variable "P-lndex" which expresses 

35 the identification number of the received data to be dis- 
played. The control unit 155 then sets a predetermined 
value, such as "1", into the variable "Cur-Pos" showing 
the cursor number which is in the selection state. Fol- 
lowing this, the control unit 155 instructs the separating 

40 unit 1 51 to obtain the transmission data indicated by the 
variable "P-lndex". The control unit 155 then interprets 
the link information in the received data which is re- 
ceived in accordance with this instruction and is stored 
in the received data holding unit 152 : and outputs the 

45 cursor information for each cursor the cursor indicated 
by the variable Cur-Pos being in the selection state, to- 
gether with the display position to the reproducing unit 
153. Here, when an interrupt from the signal receiving 
unit 156 occurs, the control unit 155 interprets the con- 

50 trol signal stored in the signal receiving unit 156. First, 
the control unit 1 55 checks whether the input signal was 
"Up", in which case the control unit 155 decreases the 
value of variable Cur-Pos by 1. If not, the control unit 
155 checks whether the input signal was "Down", in 

55 which case the control unit 155 increases the value of 
variable Cur-Pos by 1 . If not, the control unit 1 55 checks 
whether the input signal was "Enter", in which case the 
control unit 155 finds the coordinates of the display po- 
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sition from the cursor number given by the variable Cur- 
Pos, and obtains the identification number of the file 
which is the link destination file written in the hot spot 
information for these coordinates. The control unit 155 
then sets this identification number in the variable P-ln- 
dex, and instructs the separating unit 151 to obtain the 
transmission data shown by the variable P-lndex. 

Structure of the Signal Receiving Unit 156 

and the Audio Output Unit 157 

On receiving an input signal from a remote control- 
ler (not-illustrated) or the like, the signal receiving unit 
156 creates an interrupt for the control unit 155 in ac- 
cordance with the received input signal as well as hold- 
ing the received input signal. 

The audio output unit 157 can be realized by a 
speaker or the like, and is used to output the reproduced 
audio information as audio. 

Example of a Display Image 

Fig. 18 shows display image 1800 for the initial 
screen which is displayed by the display unit 1 54 based 
on the transmission data 800 shown in Figs.SA to 8C. 

As shown in Fig. 1 8 : the display image 1800 has the 
cursor design 1 801 corresponding to cursor number "1 " 
displayed at a display position (100,600) indicated by 
the display image information 801 , in accordance with 
the hot spot information given on line 812 of the link in- 
formation 803. It should be noted here that the cursor 
information which represents the selection state has 
been selected for cursor design 1801 in accordance with 
the initial value of the variable Cur-Pos which is held by 
the control unit 155. 

In the same way : the cursor design 1801 corre- 
sponding to cursor number "2" is displayed at a display 
position (100 : 700) : in accordance with the hot spot in- 
formation given on line 81 3 of the link information 803. 
It should be noted here that the cursor information which 
represents the non-selection state has been selected for 
cursor design 1 802 since its cursor number "2" does not 
coincide with the initial value of the variable Cur-Pos. 

Here, since the transmission data 800 includes au- 
dio information 802 in addition to the display image in- 
formation 801 . an audio commentary is outputted by the 
audio output unit 157 when the display image 1800 is 
displayed on the display unit 154. 

Fig. 19 shows the display image 1900 which is the 
initial screen displayed by the display unit 154 for the 
transmission data 900 shown in Figs.9A and 9B. 

As with the display image 1 800 in Fig. 1 8 : the display 
image 1900 has the cursor design 1901 displayed at a 
display position (050,400) indicated by the display im- 
age information 901 , in accordance with the hot spot in- 
formation given on line 912 of the link information 902. 
Here : the cursor information for the selection state is se- 



lected as cursor design 1901. 

Fig. 20 shows the display image 2000 which is the 
initial screen displayed by the display unit 154 for the 
transmission data 1000 shown in Fig. 1 0A and 10B. 

5 As before, the display image 2000 has the cursor 

design 2001 , which corresponds to cursor number u 1 a 
and which shows the selection state, displayed at a dis- 
play position (050 : 400) indicated by the display image 
information 1001 , in accordance with the hot spot infor- 

io mation given on line 1012 of the link information 1002. 

Specific Example of the Procedure of the Control Unit 
155 

is The following is an explanation of a specific exam- 
ple of the procedure executed by the control unit 155 
when displaying the display image 1800 on the display 
unit 154 based on the transmission data 800. 

The control unit 1 55 first sets the initial value of the 

20 variable P-lndex at "0001 " and the initial value of the 
variable Cur-Pos at "1". Next, the control unit 155 in- 
structs the separating unit 151 to obtain the display im- 
age information 801 (including the audio information 
802) and the link information 803 which have the iden- 

25 tification number "0001 " set in the variable P-lndex. The 
control unit 155 then instructs the reproducing unit 153 
to reproduce the display image information 801 (includ- 
ing audio information 802) stored in the received data 
holding unit 152. The reproducing unit 153 reproduces 

30 the display image information 801 and outputs it to-the 
display unit 1 54 and simultaneously reproduces the au- 
dio information 802 which it outputs to the audio output 
unit 1 57. The control unit 1 55 interprets the link informa- 
tion 803 stored in the received data holding unit 152 : 

35 generates a cursor design correspondence table : and 
outputs design information for each cursor and their dis- 
play positions to the reproducing unit 1 53. At this point, 
the cursor indicated by the variable Cur-Pos, which is to 
say the first cursor, is displayed in the selection state. 

*o The control unit 1 55 then waits for an input from the 
signal receiving unit 156. Here, suppose that a "Down" 
signal is inputted into the signal receiving unit 1 56 from 
an external remote controller. When the input signal is 
"Down", the control unit 155 increases the value of var- 

45 jable Cur-Pos by "V\ making it "2". Next, the cursor in- 
formation for the selection state is selected as the de- 
sign for cursor number "2" which is indicated by this up- 
dated variable Cur-Pos. and the cursor information for 
the non-selection state is selected as the design for cur- 

50 sor number "1 " which was formerly indicated by the var- 
iable Cur-Pos, with these sets of cursor information be- 
ing outputted to the reproducing unit 153. 

The control unit 155 waits for an interrupt from the 
signal receiving unit 156, with the following explanation 

55 describing the case when the signal receiving unit 156 
stores an input signal for a pressing of the "Enter" key 
after generating the interrupt. If the input signal is "En- 
ter", the control unit 155 reads the X-Y coordinates 
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(100,700) corresponding to cursor number "2" which is 
indicated by the variable Cur-Pos from the cursor design 
correspondence table. Next, the control unit 155 reads 
the identification number of the link destination file of the 
hot spot information on line 81 3 : based on these X-Y 5 
coordinates (100,700), and obtains the identification 
number "0003". Next, this identification number "0003" 
is set as the value of the variable P-lndex. Following this, 
the control unit 155 instructs the separating unit 151 to 
obtain the display image information 1001 and the link 10 
information 1002 which have the identification number 
indicated by this variable P-!ndex. The control unit 155 
then resets the variable Cur-Pos to "1 ". 

By repeating the processing described above, the 
display image 2000 shown in Fig. 20 can be displayed is 
on the display unit 1 54. Here, if an interrupt occurs when 
the value of the variable Cur-Pos is "1", and an input 
signal for "Enter" is being stored by the signal receiving 
unit 156 when the control unit 155 refers to the signal 
receiving unit 1 56, the control unit 1 55 will have the dis- 20 
play image 1900 shown in Fig. 19 displayed on the dis- 
play unit 154, as described above. 

Procedure for Display Control 

25 

Fig. 21 is a flowchart showing an example proce- 
dure for display control which is performed by the control 
unit 155. 

The control unit 155 first sets the initial value of the 
variable P-lndex which indicates the identification 30 
number of the transmission data to be obtained (step 
S2101). 

The control unit 1 55 then sets the initial value of the 
variable Cur-Pos which indicates the cursor number of 
the cursor in the selection state for the start of display 35 
of each display screen (step S2102). 

The control unit 155 then instructs the separating 
unit 151 to obtain the transmission data which has the 
identification number indicated by the variable P-lndex. 
The separating unit 151 then separates the display im- 40 
age information and link information in accordance with 
the indication from the control unit 155, and stores the 
display image information and link information with their 
identification number in the received data holding unit 
152 (step S21 03). 45 

On being instructed by the control unit 155, the re- 
producing unit 153 reproduces the display image infor- 
mation in the received data holding unit 1 52 and outputs 
it tothe display unit 1 54. When there is audio information 
which is related to the display image information, the re- 50 
producing unit 153 reproduces this audio information 
and outputs it to the audio output unit 157 (S2104). 

The control unit 155 interprets the link information 
in the received data holding unit 152 and outputs the 
design information for the cursor designs together with 55 
the X-Y coordinates for the display positions of the cur- 
sors, as well as an instruction to display the design in- 
formation tothe reproducing unit 153. The reproducing 
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unit 153 reproduces the design information inputted 
from the control unit 155 and outputs it to the display 
unit 154 (step S2105). By doing so, one display image 
is displayed by the display unit 154. 

The control unit 155 waits for an interrupt from the 
signal receiving unit 1 56 (step S2106), and on receiving 
an interrupt, checks whether the input signal held by the 
signal receiving unit 156 is "Up" (step S2107). 

If the input signal is "Up", the control unit 155 sub- 
tracts "1" from the value of the variable Cur-Pos (step 
S2108). If not, the control unit 155 checks whether the 
input signal held by the signal receiving unit 156 is 
"Down" (step S2109). 

If the input signal is "Down", the control unit adds 
"1 " to the value of the variable Cur-Pos (step S21 1 0). If 
not, the control unit 1 55 checks whether the input signal 
held by the signal receiving unit 156 is "Enter" (step 
S2111). 

If the input signal in "Enter", the control unit 155 us- 
es the cursor number shown by the variable Cur-Pos to 
reference the cursor design correspondence table and 
so finds the cursor display position (X,Y) which it then 
uses to find the value of the identification number of the 
link destination file in the hot spot information. The con- 
trol unit 155 then sets this identification number as the 
value of the variable P-lndex. After this, the processing 
returns to S2102. 

If the input signal is not "Enter", the processing re- 
turns to S2106. 

As described above, in the present embodiment the 
display image information, which conventionally would 
have had to have been generated by the data receiving 
apparatus 150 while the data receiving apparatus 150 
is interpreting the control information, is generated and 
transmitted by the data transmitting apparatus 110, 
which reduces the load of each data receiving apparatus 
150. Also, when compared with the large number and 
variety of display control processes for display character 
strings which were conventionally written intothe control 
information, the link information of the present embodi- 
ment contains a smaller number and less variety of con- 
trol processes. As a result, simulated bidirectional com- 
munication can be easily achieved by the data receiving 
apparatuses 150 using this link information. 

The present embodiment describes the case when 
in order to display WWW home pages on the Internet, 
the data communication system 100 uses a one-to- 
many TV broadcast to perform simulated bidirectional 
communication, so that when compared to the case 
when home pages are displayed by a browser on a per- 
sonal computer, the display of the user's desired pages 
on the display unit 1 54 can be performed at a high speed 
which is unaffected by congestion. Since display image 
information is sent in a conventional TV format, the dis- 
play of full color, high-resolution images can easily be 
achieved by the display unit 1 54. Also, while the display 
of display images generated by a browser for display on 
a TV monitor does not make full use of the components, 
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such as the reproduction processing for display images, 
conventionally provided inside a TV : the present embod- 
iment can achieve simulated bidirectional communica- 
tion which makes full use of circuitry s such as memory 
and decoders, conventionally provided inside a TV set. s 

In the present embodiment, while the information to 
be obtained has been described as HTML documents 
which are used on the WWW together with compressed 
image information in GIF format and audio information 
in AU format, information expressed in other formats or w 
languages, such as HyperCards, can be used. In such 
case, the processing for "<A>" tags refer to a method 
for conversion for the corresponding format and lan- 
guage. The present embodiment also describes the 
conversion of an HTML document containing only a !im- *s 
ited number of tags, although other HTML tags may also 
be included. 

The present embodiment also describes an exam- 
ple where the control for simulated bidirectional commu- 
nication performed according to the link information is 20 
the switching of the display to another display image, 
although other processes, such as a process for flashing 
display on the screen, a process for scrolling the display 
image, or a process for activating a device such as a 
fax, telephone, or video recorder connected to the data 25 
receiving apparatus, may be performed in addition to 
simulated bidirectional communication. 

The data communication system 100 is also de- 
scribed as having identification numbers of files written 
into the link information by the transmission data gener- 30 
ating unit 1 1 2, although this process need not to be per- 
formed. As one alternative, the original file name may 
be written into the link information as the file identifica- 
tion number. When doing so, the file name can be at- 
tached to the display image information (including audio os 
information) and link information in each set of transmis- 
sion data during transmission, with the data receiving 
apparatus 150 which receives this information succes- 
sively obtaining a complete set of link information after 
being switched on, so that it can then investigate the 40 
correspondence between file names and identification 
numbers. 

The data receiving apparatus 1 50 may also store a 
complete set of display image information and link infor- 
mation which are repeatedly transmitted by the data is 
transmitting apparatus 110 in the received data holding 
unit 152. 

When the transport stream shown in Fig. 11 B is 
transmitted from the data transmitting apparatus 110, 
the receiving apparatus 1 50 may first have the separat- so 
ing unit 151 separate and obtain the PMT, before read- 
ing the PMT to find the PID of the display image infor- 
mation to be obtained and having the display image in- 
formation separated and obtained from the transport 
stream with the read PI D as a filter condition. It may also ss 
read the PID of the private stream including the link in- 
formation from the PMT, and then separate and obtain 
the link information from the transport stream with the 



PID and the identification number (table ID extension) 
as the filter conditions. 

The transport stream shown in Fig. 1 1 B was also de- 
scribed as having a video elementary stream made up 
of I pictures, although the video elementary stream may 
include B pictures and P Pictures. The display image 
information was also described as being encoded ac- 
cording to MPEG2 standard, although it may alternative- 
ly be encoded under another standard, such as MPEG 1 , 
JPEG, or GIF. Finally, the display image information and 
audio information were described as being transmitted 
as a video elementary stream and an audio elementary 
stream, although they may be multiplexed as private 
sections in the same way as the link information. 

Second Embodiment 

FIG. 22 is a block diagram showing the structure of 
a data communication system 2200 of the second em- 
bodiment of the present invention. In this figure, the 
same components as the components of the data com- 
munication system 100 are indicated by the same ref- 
erence numerals as in FIG. 1, and those components 
are not described below. In this embodiment, audio in- 
formation is processed in the same manner as in the 
first embodiment, and therefore this process is not de- 
scribed below, either. 

The data communication system 2200 comprises a 
data transmitting apparatus 221 0 and the data receiving 
apparatus 150. 

The data transmitting apparatus 2210 includes a 
first obtaining unit 2211 and a second obtaining unit 
221 2 in place of the information obtaining unit 11 1 of the 
data transmitting apparatus 110, and it also includes a 
transmission data generating unit 2213 in place of the 
transmission data generating unit 112. 

The first obtaining unit 2211 is connected to a first 
external database 2221 , and has the same structure as 
the information obtaining unit 111 shown in FIG. 1. Just 
like the information obtaining unit 111 , the first obtaining 
unit 2211 fetches files shown in FIGs. 2 to 6 from the 
first external database, and stores them into an internal 
buffer with a name allotted to each of them. 

The first external database 2221 is the same as the 
external database shown in FIG. 1. 

The second obtaining unit 2212 is connected to a 
second external database 2222 which is provided apart 
from the first external database 2221. The second ob- 
taining unit 2212 is substantially the same as the infor- 
mation obtaining unit 111 and the first obtaining unit 
2211, except that it fetches files from the second exter- 
nal database 2222 one by one. 

The second external database 2222 stores image 
information files created in a predetermined format of 
display size. 

FIG. 23 shows an example of the image information 
2301 "CM0001.BMP" which the second obtaining unit 
2212 fetches from the second external database 2222. 
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As shown in FIG. 23. the image information 2301 is 
made a predetermined display size, and it displays an 
advertisement for a personal computer. An extension *'. 
BMP" of the file name of the image information file indi- 
cates Lhat the image information 2301 is represented 5 
by bitmap data. 

The transmission data generating unit 2213 in- 
cludes a data conversion table storing unit (not shown) 
and a storing unit (not shown) which serves as a work 
area for transmission data generation. The data conver- w 
sion table storing unit stores the compression ratio of 
the display image formed in accordance with the display 
image information generated from the HTML document 
of the first obtaining unit 2211 as well as the same con- 
tents as the data conversion table storing unit 1 22. The *5 
work area includes a holding area for temporarily hold- 
ing display information of one frame generated in ac- 
cordance with an HTML document obtained from the 
first obtaining unit 2211 , as well as the same storage 
area as in the work area of the transmission data gen- 20 
erating unit 112. 

The transmission data generating unit 221 3 gener- 
ates below-mentioned first display image information 
and link information from an HTML document obtained 
by the first obtaining unit 2211 , and generates below- 25 
mentioned second display image information in accord- 
ance with the image information obtained by the second 
obtaining unit 2212. 

More specifically : the transmission data generating 
unit 221 3 fetches an HTML document from the buffer in 30 
the first obtaining unit 221 1, and stores the fetched 
HTML document into the file storage area in the work 
area. The contents of the HTML document are interpret- 
ed in the same manner as in the transmission data gen- 
erating unit 1 1 2. According to the interpreted results : the 35 
display character string is converted into images, or des- 
ignated image information is decompressed to generate 
display image information of the generated part of the 
display character string. The display image information 
generated by converting display character string into im- io 
ages or by decompressing designated image informa- 
tion is stored sequentially in the holding area in the work 
area. 

The transmission data generating unit 2213 inter- 
prets the fetched HTML document till the end : and gen- 45 
erates corresponding display image information and link 
information. It then compresses the display images rep- 
resented by display image information stored in the 
holding area in the work area at the ratio stored in the 
data conversion table storing unit so as to generate first so 
display image information representing the compressed 
display images. The generated first display image infor- 
mation is then stored in a display image information stor- 
age area in the display image information storing unit 
123. 55 

The transmission data generating unit 2213 recal- 
culates the cursor display position in the hot spots in the 
compressed display images and updates the X-Y coor- 
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dinates of the hot spot information in the link information 
storing unit 125. It then fetches one file of image infor- 
mation from the second obtaining unit 2212 and gener- 
ates second display image information based on the 
fetched image information. The generated second dis- 
play image information is then added to the display im- 
age information storage area. The image information 
files stored in the second external database 2222 are 
produced in such a format that they can be used as the 
second display image information without any modifica- 
tion. 

As described above : the transmission data gener- 
ating unit 2213 one file of transmission data based on 
the first display image information generated in accord- 
ance with one file of HTML document in the first obtain- 
ing unit 2211 and the link information, and the second 
display image information generated in accordance with 
one file of image information stored in the second ob- 
taining unit 221 2. The transmission data generating unit 
2213 then allots transmission data an identification 
number corresponding to the generated display image 
information and the link information. 

The above procedure is repeated for generating 
files of transmission data. 

FIGs. 24A to 24C show an example of transmission 
data generated by the transmission data generating unit 
221 3. FIG. 24A shows the contents of first display image 
information 2401 by way of an image displayed based 
on the first display image information 2401. FIG. 24B 
shows audio information corresponding to the first dis- 
play image information 2401. FIG. 24C shows the con- 
tents of link information 2403. 

Transmission data 2400 are created by combining 
the HTML document 301 shown in FIG. 2 obtained by 
the first obtaining unit 2211, the audio information 
"Weather, au" (not shown) and the image information 
401 shown in FIC. 3, and the image information 2301 
shown in FIG. 23 obtained by the second obtaining unit 
2212. 

The display image expressed by the first display im- 
age information 2401 is the same as the display image 
expressed by the display image information shown in 
FIG. 8A generated by the transmission data generating 
unit 112 : except that it is reduced by a predetermined 
ratio. The display image expressed by the second dis- 
play image information 2402 is the same as the display 
image expressed by the image information 2301 ob- 
tained by the second obtaining unit 221 2. One file of the 
transmission data 2400 consists of the first display im- 
age information 2401 and the second display image in- 
formation 2402 so as to display an image for one page 
of the WWW home pages. 

The X-Y coordinates of the hot spot information on 
line 2411 in the link information 2403 are the same as 
the X-Y coordinates shown on line 2412 in the link in- 
formation 803 : except that they are updated in accord- 
ance with the reduction ratio. Likewise, the X-Y coordi- 
nates of the hot spot information on line 2412 are ob- 
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tained by updating the X-Y coordinates on line 313 in 
the link information 803. 

FIG. 25 shows the initial display image displayed on 
the display unit 154 based on the transmission data 
2400 shown in FIG. 24. 

In a display image 2500, a cursor design 2501 cor- 
responding to a cursor number "1 " is displayed at a dis- 
play position (080, 480) in the display image expressed 
by the first display image information 2401 and the sec- 
ond display image information 2402 in accordance with 
the hot spot information on line 241 in the link informa- 
tion 2403. Likewise, a cursor design 2502 correspond- 
ing to a cursor number "2" is displayed at a display po- 
sition (080 5 560) in accordance with the hot spot infor- 
mation on line 2412 in the link information 2403. The 
cursor design 2502 indicates a non-selected status. 

FIG. 26 is a flowchart showing an example proce- 
dure for generating transmission data by the transmis- 
sion data generating unit 2213. 

The transmission data generating unit 221 3 checks 
whether unprocessed HTML documents exist in the first 
obtaining unit 221 1 (step S2601 ). If there is any unproc- 
essed HTML document, one file of HTML document is 
extracted (step S2602), and display image information 
is generated in the holding area, and link information is 
generated in the link information storing unit 125 in the 
same manner as the transmission data generating unit 
112 of the first embodiment (step S2603). 

The transmission data generating unit 2213 then 
generates the first display image information by reduc- 
ing the display image expressed by the display image 
information stored in the holding area by a predeter- 
mined ratio. The first display image information is stored 
into the display image information storing unit 1 23 (step 
S2604). 

The cursor display position (X, Y) in the display im- 
age expressed by the first display information is calcu- 
lated, and according to the calculation result, the cursor 
display position (X, Y) of the hot spot information is up- 
dated (step S2605). 

An image information file is fetched from the second 
obtaining unit 2212 (step S2606). The second display 
image information is then generated (step S2607), and 
added to the display image information storage area of 
the display image information storing unit 123. 

An identification number is allotted to the display im- 
age information and the link information stored in the 
display image information storing unit 123 and the link 
information storing unit 125, respectively (step S2608). 
The processing then returns to step S2601. 

As described so far, with the data communication 
system of this embodiment, the same effects as in the 
first embodiment can be obtained in the case where the 
display image on the display unit 154 is synthesized 
based on information provided from the external data- 
base 2221 and the external database 2222. 

Although the data transmission apparatus 2210 
comprises two information obtaining units, i.e., the first 



obtaining unit 2211 and the second obtaining unit 2212, 
it should be noted that the number of information obtain- 
ing units is not necessarily two and it may be three or 
more. 

5 Also, the second external database 2222 stores im- 

age information in the form of bitmap data expressing 
display images of a predetermined display size, but the 
image information stored in the second external data- 
base 2222 is not necessarily expressed by bitmap data, 

w and it may be compressed in accordance with GIF for- 
mat or others. In such acase, the transmission data gen- 
erating unit 2213 decompresses the image information 
fetched from the second obtaining unit 2212 in accord- 
ance with a given format to generate second display im- 

is age information. The second external database 2222 
may be a different WWW server from the first external 
database 2221. In such a case, the transmission data 
generating unit 2213 generates the second display im- 
age information and corresponding link information in 

20 the same manner as in generating the first display image 
information and corresponding link information. 

Third Embodiment 

25 FIG. 27 is a block diagram showing the structure of 

the data communication system 2700 of the third em- 
bodiment of the present invention. In FIG. 27, the same 
components as in the data communication system 100 
are indicated by the same reference numerals as in FIG. 

30 1 . The explanations for them are not provided below. 

The data communication system 2700 comprises a 
first data transm itting apparatus 27 1 0 and a second data 
transmitting apparatus 2720, and a data receiving ap- 
paratus 2750. 

35 The data receiving apparatus 2750 is provided with 
a separating unit 2751 , a receiving unit 2752, and a syn- 
thesizing unit 2753, in place of the receiving unit 151 of 
the data receiving unit 151. v 

40 First Data Transmitting Apparatus 2710 

The first data transmitting apparatus 2710 has the 
same structure as the data transmitting unit 2210, ex- 
cept that it does not comprise the second obtaining unit 

45 2212. The first data transmitting apparatus 2710 is con- 
nected to the same external database as the first exter- 
nal database 2221. 

A transmission data generating unit (not shown) in 
the first data transmitting apparatus 271 0 generates first 

50 display image information and corresponding link infor- 
mation in the same manner as the transmission data 
generating unit 221 3. This transmission data generating 
unit differs from the transmission data generating unit 
2213 in that it generates first display image information 

55 and leaves the display area for second display image 
information blank so that display image information con- 
sisting of the first display image information and the 
blank area can be generated. 
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FIGs. 28A to 28C show transmission data 2800 
generated by the first data transmitting apparatus 2710 
based on the HTML document 301 shown in FIG. 3.. the 
audio information "weather.au" : and the image informa- 
tion 410 shown in FIG. 4. FIG. 28A shows the contents 
of first display image information 2801 by way of an im- 
age displayed based on the first display image informa- 
tion 2801 . FIG. 28B shows the audio information corre- 
sponding to the first display image information 2801. 
FIG. 28C shows the contents of the link information 
2803. 

As can be seen from FIGs. 28A to 28C, the first dis- 
play image information 2801 , the audio information, and 
the link information 2803 are the same as the first dis- 
play image information 2401 , the audio information, and 
the link information 2403 shown in FIG. 24. The trans- 
mission data 2800 differs from the transmission data 
2400 in that a blank area 2802 is provided in place of 
the display area for the second display image informa- 
tion 2402. 

Second Data Transmission Apparatus 2720 

The second data transmission apparatus 2720 
comprises a transmission data holding unit (not shown) 
and a timer (not shown) for measuring a fixed time, and 
sequentially transmits files of transmission data stored 
in the transmission data holding unit. One file is trans- 
mitted in one fixed period of time measured by the timer. 
The files of transmission data are generated in a prede- 
termined format in advance. 

The second data transmission apparatus 2720 
transmits transmission data in the same manner as in 
the conventional TV broadcasting. It should be noted 
that the second data transmission unit may be a record- 
ing medium reproducing apparatus connected to the da- 
ta receiving apparatus 2750, such as a DVD (Digital Ver- 
satile Disc) reproducing apparatus and a CD (Compact 
Disc) reproducing apparatus. 

FIG. 29 shows transmission data 2900 transmitted 
from the second data transmission apparatus 2720. 

As can be seen from FIG. 29, the transmission data 
2900 comprises a blank area 2901 of a predetermined 
size in stead of the display area for first display image 
information. It also includes a display area for displaying 
an image expressed by second display image informa- 
tion below the blank area 2901 . 

Data Receiving Apparatus 2750 

The separating unit 2751 is the same as the sepa- 
rating unit 151 shown in FIG. 1, except that it outputs 
display image information and link information stored in 
the read buffer to the synthesizing unit 2753. 

The receiving unit 2752 may take the form of a con- 
ventional TV tuner having an A/D conversion circuit. It 
receives second display image information transmitted 
from the second data transmission apparatus 2720 and 
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outputs the received second display image information 
to the synthesizing unit 2753. 

The synthesizing unit 2753 controls the display im- 
age information storage area for one image included in 

s the received data holding unit 1 52. Here, the display im- 
age information storage area is divided into a first dis- 
play image information area and a second display image 
information area. The synthesizing unit 2753 writes first 
display image information among transmission data in- 

io putted through the separating unit 2751 into the first dis- 
play image information area, while it writes second dis- 
play image information inputted through the receiving 
unit 2752 into the second display image information ar- 
ea. The display image 2500 shown in FIG. 25 is thus 

15 displayed on the display unit 154. In this embodiment, 
second display images are sequentially switched in the 
same timing as the transmission data switching by the 
second data transmission apparatus 2720. 

As described above, this embodiment of the 

20 present invention can bring about the same effects as 
the data communication system 100, even in the case 
where display images expressed by a plurality of pieces 
of display image information are displayed as one image 
based on transmission data transmitted from a plurality 

25 of data transmitting units. 

Although the data receiving apparatus 2750 of this 
embodiment comprises the separating unit 2751 and 
the receiving unit 2752, it may comprise more than two 
receiving units. 

30 (n this embodiment, the second data transmitting 
apparatus 2720 transmits transmission data comprising 
only second display image information without multi- 
plexing, but like the first data transmitting apparatus 
2710, it may transmit multiplexed transmission data 

35 consisting of second display image information and cor- 
responding link information. In such a case, the receiv- 
ing unit 2752 has the same structure as the separating 
unit 2751, and the synthesizing unit 2753 synthesizes 
display image information inside the received data hold- 

40 jng unit 1 52 based on the first display image information 
and the second display image information. The link in- 
formation incorporated into the transmission data by the 
receiving unit 2752 is added to the link information ob- 
tained by the separating unit 2751 and stored in the re- 

45 ceived data holding unit 152. 

In the first, second, and third embodiments, the data 
receiving apparatus 150 stores design information ex- 
pressing cursor designs inside the control unit 155 in 
advance, but design information transmitted from the 

50 data transmitting apparatus 110 may be stored in the 
control unit 155. In such a case, the data transmitting 
apparatus and the data receiving apparatus have the 
structures shown in FIG. 30. As can be seen from this 
figure, a supplementary design adding unit 3211 is add- 

55 ed to the data transmitting unit 110 shown in FIG. 1, 
while a supplementary design obtaining unit 3253 is 
added to the receiving apparatus 150. The external da- 
tabase further stores design information expressing cur- 
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sor designs. 

The supplementary design adding unit 3211 reads 
the design information from the external database and 
adds it to the link information stored in the transmission 
data holding unit 113. 5 

The supplementary design obtaining unit 3253 
reads only the design information from the link informa- 
tion stored in the received data holding unit 152 and 
stores it into a design information storing unit in the con- 
trol unit 155. Successively the design information is de- io 
leted from the link information stored in the received da- 
ta holding unit 1 52. With this structure, the design infor- 
mation fetched from the external database by the data 
transmitting apparatus 1 1 0 is transmitted to the data re- 
ceiving apparatus 150, so that supplementary designs '5 
to be stored in the data receiving apparatus 1 50 can be 
changed variously. 

Although the present invention has been fully de- 
scribed by way of example with reference to the accom- 
panying drawings, it is to be noted that various changes 20 
and modifications will be apparent to those skilled in the 
art. Therefore., unless otherwise such changes and 
modifications depart from the scope of the present in- 
vention, they should be construed as being included 
therein. 25 



output means foroutputting the multiplexed tel- 
evision signal as an analog broadcast wave. 

A transmitting apparatus according to Claim 1, 
wherein 

said image data and control information 
stored in said first and second storage means are 
digitized, and 

said transmitting means comprises: 

reading means for repeatedly reading said pre- 
determined number of frames of image data to- 
gether with said corresponding control informa- 
tion from said first and second storage means: 
multiplexing means for converting image data 
and control information read by said reading 
means into digital data streams, and multiplex- 
ing said digital data streams so as to produce 
a multiplexed stream: and 
output means for outputting said multiplexed 
stream as a digital broadcast wave. 

A transmitting apparatus for an interactive commu- 
nication system using a broadcast wave, compris- 
ing: 



Claims 

1 . A transmitting apparatus for an interactive commu- 
nication system using a broadcast wave, compris- 
ing: 

first storage means for storing a plurality of 
frames of image data: 

second storage means for storing control infor- 
mation, for each frame of image data, showing 
a link to another frame of image data stored in 
said first storage means: and 
transmitting means for repeatedly transmitting 
a predetermined number of frames of image 
data together with corresponding control infor- 
mation. 



first storage means for storing a plurality of 
frames of image data with an identifier allotted 
to each frame of image data: 

30 second storage means for storing control infor- 

mation, for each frame of image data, showing 
a link to another frame of image data stored in 
said first storage means, the same identifier be- 
ing allotted to corresponding image data and 

35 control information: and 

output means for repeatedly outputting a pre- 
determined number of frames of image data to- 
gether with corresponding control information. 

40 5. A transmitting apparatus according to Claim 4 : 
wherein 

said control information expresses identifiers 
allotted to linked image data. 



2. A transmitting apparatus according to Claim 1, 6. 
wherein 

said transmitting means comprises: 

reading means for repeatedly reading said pre- 
determined number of frames of image data to- so 
gether with said corresponding control informa- 
tion from said first and second storage means: 
multiplexing means for multiplexing image data 
and control information read by said reading 
means by transmitting said image data and 55 
control information in image sections and ver- 
tical blanking intervals, respectively, of a televi- 
sion signal: and 



A transmitting apparatus according to Claim 5, 
wherein 

said transmitting means comprises: 

reading means for repeatedly reading all com- 
binations of image data and control information 
from said first and second storage means, each 
combination including image data and control 
information with the same identifier: 
multiplexing means for multiplexing image data 
and control information read by said reading 
means by transmitting said image data and 
control information in image sections and ver- 
tical blanking intervals, respectively, of a televi- 
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sion signal; and 

output means for outputting the multiplexed tel- 
evision signal as an analog broadcast wave. 

7. A transmitting apparatus according to Claim 6 : s 
wherein 

said multiplexing means incorporates an im- 
age representing an identifier in a fixed position in 
a non-displayed part of an image section. 

w 

8. A transmitting apparatus according to Claim 5, 
wherein 

said transmitting means comprises: 

reading means for repeatedly reading all com- ?5 
binations of image data and control information 
from said first and second storage means ; each 
combination including one frame of image data 
and corresponding control information with the 
same identifier: 20 
multiplexing means for converting image data 
and control information read by said reading 
means into digital data streams, and multiplex- 
ing said digital data streams so as to produce 
a multiplexed stream: and 25 
output means for outputting said multiplexed 
stream as a digital broadcast wave. 



9. A transmitting apparatus according to Claim 8 : 
wherein 30 

said multiplexing means comprises: 

a converter for converting image data into a first 
digital data stream and control information into 
a second digital data stream: 35 
an ID allotting unit for allotting said first digital 
data stream first identifying information for 
identifying image data and said second digital 
data stream second identifying information for 
identifying control information: 40 
a table producing unit for producing a map table 
showing the correspondence between said first 
identifying information and image data identifi- 
ers and the correspondence between said sec- 
ond identifying information and control informa- 45 
tion identifiers: and 

a multiplexing unit for multiplexing said first dig- 
ital data stream said second digital data 
stream, and said map table. 

50 

10. A transmitting apparatus according to Claim 5, fur- 
ther comprising 

third storage means for storing audio data cor- 
responding to said image data the same identifier 
being allotted to corresponding image data and au- 55 
dio data, 

wherein 

said transmitting means transmits audio data 



as well as image data. 

11. A transmitting apparatus according to Claim 10, 
wherein 

said transmitting means comprises: 

reading means for repeatedly reading all com- 
binations of image data, control information, 
and audio data from said first, second, and third 
storage means, each combination including im- 
age data, control information, and audio data 
with the same identifier: 

multiplexing means for multiplexing a combina- 
tion of image data, control information, and au- 
dio data read by said reading means to produce 
a television signal, said audio data being trans- 
mitted on a television audio signal, said image 
data and control information corresponding to 
said audio data being repeatedly transmitted in 
image sections and vertical blanking intervals, 
respectively, of a television image signal, and 
the repetition rate of said image data and con- 
trol information depending on the time during 
which said audio data are transmitted: and 
output means for outputting the multiplexed tel- 
evision signal as an analog broadcast wave. 

12. A transmitting apparatus according to Claim 11. 
wherein 

said multiplexing means incorporates an im- 
age representing an identifier in a fixed position in 
a non-displayed part of an image section. 

13. A transmitting apparatus according to Claim 10, 
wherein 

said transmitting means comprises: 

reading means for repeatedly reading all com- 
binations of image data, control information, 
and audio data from said first, second, and third 
storage means, each combination including 
one frame of image data, control information, 
and audio data with the same identifier: 
multiplexing means for converting image data, 
audio data, and control information read by said 
reading means into digital data streams, and 
multiplying said digital data streams so as to 
produce a multiplexed stream: and 
output means for outputting said multiplexed 
stream as a digital broadcast wave. 

14. A transmitting apparatus according to Claim 13, 
wherein 

said multiplexing means comprises: 

a converter for converting image data into a first 
digital data stream, control information into a 
second data stream, and audio data into a third 



24 

BNSDOCID: <EP 0810789A2J_> 



47 



EP 0 810 789 A2 



48 



digital data stream: 

an ID allotting unit for allotting said first digital 
data stream first identifying information to iden- 
tify image data, said second digital data stream 
second identifying information to identify con- s 
trol information., and said third digital data 
stream third identifying information to identify 
audio data: 

a table producing unit for producing a map table 17. 
showing the correspondence between said first 10 
identifying information and image data identifi- 
ers, the correspondence between said second 
identifying information and control information 
identifiers, and the correspondence between 18. 
said third identifying information and audio data 75 
identifiers: and 

a multiplexing unit for multiplexing said first, 
second, and third digital data streams, and said 
map table. 

20 

15. A transmitting apparatus according to Claim 4, fur- 
ther comprising: 

image storage means for storing an additional 
image: 25 
image reading means for reading said addition- 
al image from said image storage means, and 19. 
image data from said first storage means: and 
image adding means for adding said additional 
image to said image data, 30 

wherein 

said transmitting means transmits image data 
having an additional image and corresponding con- 
trol information. 35 

16. A transmitting apparatus for an interactive commu- 
nication system using a broadcast wave, compris- 
ing: 

obtaining means for obtaining pieces of page 
information representing a page containing 
characters and images, said page information 
including link information to show a link to an- 
other page, character information, and image 
information: 

first producing means for producing one frame 
of image data containing characters and imag- 
es in accordance with said character informa- 
tion and image information included in a piece so 
of page information: 21. 
second producing means for producing control 
information, for each frame of image data, 
showing a link to another frame of image data 
by reading said link information included in said 55 
obtained page information: 
first storage means for storing a predetermined 
number of frames of image data produced by 
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said first producing means: 
second storage means for storing said control 
information produced by said second produc- 
ing means: and 

transmitting means for repeatedly transmitting 
said predetermined number of frames of image 
data together with said control information. 

A transmitting apparatus according to Claim 16, 
wherein 

said obtaining means obtains said page infor- 
mation from the World Wide Web on the Internet. 

A transmitting apparatus according to Claim 16, 
wherein 

said first producing means allots an identifier to 
image data, said second producing means al- 
lots said identifier to control information corre- 
sponding to said image data, 
said first and second storage means store said 
image data and control information together 
with said identifier, and 

said control information expresses the identifier 
of linked image data. 

A transmitting apparatus according to Claim -18, 
wherein 

said transmitting means comprises: 

reading means for repeatedly reading all com- 
binations of image data and control information 
from said first and second storage means, each 
combination including one frame of image data 
and control information with the same identifier: 
multiplexing means for multiplexing image data 
and control information read by said reading 
means by transmitting said image data and 
control information in image sections and ver- 
tical blanking intervals, respectively, of a televi- 
sion signal: and 

output means for outputting the multiplexed tel- 
evision signal as an analog broadcast wave. 

A transmitting apparatus according to Claim 19, 
wherein 

said multiplexing means incorporates an im- 
age representing an identifier in a fixed position in 
a non-displayed part of said image data. 

A transmitting apparatus according to Claim 18, 
wherein 

said transmitting means comprises: 

reading means for repeatedly reading all com- 
binations of image data and control information 
from said first and second storage means, each 
combination including one frame of image data 
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and corresponding control information with the 
same identifier: 

multiplexing means for converting image data 
and control information read by said reading 
means into digital data streams : and multiplex- 5 
ing said digital data streams so as to produce 
a multiplexed stream: and 
output means for outputting said multiplexed 
stream as a digital broadcast wave. 

w 

22. A transmitting apparatus according to Claim 21 , 
wherein 

said multiplexing means comprises: 

a converter for converting image data into a first 15 
digital data stream and control information into 
a second digital data stream: 
an ID allotting unit for allotting said first digital 
data stream first identifying information for 
identifying image data and said second digital 20 
data stream second identifying information for 
identifying control information: 
a table producing unit for producing a map table 
showing the correspondence between said first 
identifying information and image data identifi- 25 
ers and the correspondence between said sec- 
ond identifying information and control informa- 
tion identifiers: and 

a multiplexing unit for multiplexing said first dig- 
ital data stream, said second digital data 30 
stream, and said map table. 

23. A transmitting apparatus according to Claim 1 8, fur- 
ther comprising: 

35 

third producing means for producing audio data 
according to audio information contained in 
said page information, and allotting said identi- 
fier to said audio data corresponding to said im- 
age data: and ' 40 
third storage means for storing said audio data 
together with said identifier 

wherein 

said transmitting means transmits said audio 45 
data as well as said image data. 

24. A transmitting apparatus according to Claim 23, 
wherein 

said transmitting means comprises: so 

reading means for repeatedly reading all com- 
binations of image data, control information, 
and audio information from said first, second, 
and third storage means, each combination in- 55 
eluding image data, control information., and 
audio data with the same identifier: 
multiplexing means for multiplexing one combi- 



nation of image data, control information : and 
audio data read by said reading means to pro- 
duce a television signal, said audio data being 
transmitted on a television audio signal, said 
image data and control information corre- 
sponding to said audio data being repeatedly 
transmitted in image sections and vertical 
blanking intervals, respectively, of a television 
image signal, and the repetition rate of said im- 
age data and control information depending on 
the time during which said audio data are trans- 
mitted; and 

output means for outputting the multiplexed tel- 
evision signal as an analog broadcast wave. 

25. A transmitting apparatus according to Claim 23, 
wherein 

said multiplexing means incorporates an im- 
age representing an identifier in a fixed position in 
a non-displayed part of an image section. 

26. A transmitting apparatus according to Claim 23, 
wherein 

said transmitting means comprises: 

reading means for repeatedly reading all com- 
binations of image data, control information, 
and audio data from said first, second, and third 
storage means, each combination including im- 
age data, control information, and audio data 
with the same identifier: 

multiplexing means for converting image data, 
control information, and audio data read by said 
reading means into digital data streams, and 
multiplexing said digital data streams so as to 
produce a multiplexed stream: and 
output means for outputting said multiplexed 
streams as a digital broadcast wave. 

27. A transmitting apparatus according to Claim 26, 
wherein 

said multiplexing means comprises: 

a converter for converting image data into a first 
digital data stream, control information into a 
second digital data stream, and audio data into 
a third digital data stream: 
an ID allotting unit for allotting first identifying 
information to said first digital data stream to 
identify image data, second identifying informa- 
tion to said second digital data stream to iden- 
tify control information, and third identifying in- 
formation to said third digital data stream to 
identify audio data: 

a table producing unit for producing a map table 
showing the correspondence between said first 
identifying information and image data identifi- 
ers, the correspondence between said second 
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identifying information and control information 
identifiers, and the correspondence between 
said third identifying information and audio data 
identifiers: and 

a multiplexing unit for multiplexing said first, 
second, and third digital data streams, and said 
map table. 

28. A transmitting apparatus according to Claim 1 6, fur- 
ther comprising: 

image storage means for storing an additional 
image: 

image reading means for reading said addition- 
al image from said image storage means: and 
image adding means for adding said additional 
image to image data produced by said first pro- 
ducing means, 

wherein 

said transmitting means transmits said image 
data having said additional image and correspond- 
ing control information. 

29. A receiving apparatus for an interactive communi- 
cation system using a broadcast wave produced by 
multiplexing a plurality of frames of image data and 
control information showing links between said plu- 
rality of frames of image data, said broadcast wave 
being repeatedly transmitted, 

characterized by comprising: 

separating means for separating a frame of im- 
age data and corresponding control information 
from said broadcast wave: 
storage means for storing said separated im- 
age data and control information: 
reproducing means for reproducing said stored 
image data to output an image signal: 
operation means for receiving a user operation 
to switch image data: and 
control means for controlling said separating 
means so as to separate another frame of im- 
age data designated by said control information 
stored in said storage means according to said 
user operation. 

30. A receiving apparatus according to Claim 29, 
wherein 

the identifier allotted to a frame of image data 
is the same as the identifier allotted to corre- 
sponding control information, 
said control information expresses the identifier 
allotted to linked image data, 

said separating means comprises: 



first detecting means for detecting an identifier 
allotted to image data from said broadcast 
wave: 

second detecting means for detecting said 
5 identifier allotted to corresponding control infor- 

mation from said broadcast wave: and 
obtaining means for obtaining said image data 
and control information if said first and second 
detecting means have detected said identifier 
w and 

said storage means stores said image data and 
control information obtained by said obtaining 
means. 

is 31. A receiving apparatus according to Claim 30. 
wherein 

image data and control information are trans- 
mitted in image sections and vertical blanking 

20 intervals, respectively, of a television signal as 

a multiplexed analog broadcast wave, 
an identifier to be shown as an image is trans- 
mitted at a fixed position in non-displayed part 
of an image section, and 

25 said first detecting means recognizes an iden- 

tifier from an image at a fixed position in said 
non-displayed part. 

32. A receiving apparatus according to Claim 29,- 
30 wherein 

the same identifier is allotted to image data and 

corresponding control information, 

said image data and control information are 

3S converted into digital data streams to be multi- 

plexed to transmit a multiplexed stream as a 
multiplexed digital broadcast wave, 
said digital data streams are allotted first iden- 
tifying information to identify image data and 

-*o second identifying information to identify con- 

trol information, 

said multiplexed stream comprises said digital 
data streams and a map table showing the cor- 
respondence between said first identifying in- 

45 formation and image data identifiers and the 

correspondence between said second identify- 
ing information and control information identifi- 
ers, said digital data streams and said map ta- 
ble being multiplexed, 

50 said storage means stores a map table sepa- 

rated by said separating means, 
said control means recognizes an identifier of 
linked image data indicated by control informa- 
tion, converts said identifier into first identifying 

55 information and second identifying information 

referring to a map table, and sets said first iden- 
tifying information and second identifying infor- 
mation to said separating means, and 
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said separating means comprises: 

first detecting means for detecting said first 
identifying information from said multiplexed 
stream: 5 
second detecting means for detecting said sec- 
ond identifying information from said multi- 
plexed stream: and 

obtaining means for obtaining image data and 
control information indicated by said first and w 
said second identifying information detected by 
said first and second detecting means. 

33. A receiving apparatus according to Claim 29, 
wherein 15 

said control information is expressed by at least 
one combination of a coordinate on which an 
image part is centered in image data corre- 
sponding to said control information, and the 20 
identifier allotted to linked image data, 
said operation means receives a user instruc- 
tion to designate said image part in image data, 
and 

said control means reads the identifier allotted 25 
to linked image data corresponding to said des- 
ignated image region, and sets said identifier 
to said separating means. 

34. A receiving apparatus for an interactive communi- 30 
cation system using a broadcast wave produced by 
multiplexing a plurality of frames of image data, con- 
trol information to show links between said plurality 

of frames of image data, and audio data corre- 
sponding to said plurality of frames of image data, 35 
said broadcast wave being repeatedly transmitted, 
characterized by comprising: 

separating means for separating a frame of im- 
age data, and corresponding control informa- 
tion and audio data from said broadcast wave: 
storage means for storing said separated im- 
age data, control information, and audio data: 
reproducing means for reproducing said stored 
image data and audio data to output an image 
signal and an audio signal: 
operation means for receiving a user operation 
to switch image data: and 
control means for controlling said separating 
means so as to separate another frame of im- so 
age data designated by said control information 
stored in said storage means according to said 
user operation. 

35. A receiving apparatus according to Claim 34, 55 
wherein 

the identifier allotted to a frame of image data 
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is the same as the identifier allotted to corre- 
sponding control information, 
said control information expresses the identifier 
allotted to linked image data, 

said separating means comprises: 

first detecting means for detecting an identifier 
allotted to image data from said broadcast 
wave: 

second detecting means for detecting said 
identifier allotted to corresponding control infor- 
mation from said broadcast wave: and 
obtaining means for obtaining said image data 
and control information if said first and second 
detecting means have detected said identifier, 
and 

said storage means stores said image data and 
control information obtained by said obtaining 
means. 

36. A receiving apparatus according to Claim 35, 
wherein 

said separating means further comprises 

audio separating means for separating audio 
data corresponding to said image data, and 
said storage means stores said audio data sep- 
arated by said audio separating means. 

37. A receiving apparatus according to Claim 34. 
wherein 

image data and control information are trans- 
mitted in image sections and vertical blanking 
intervals, respectively of a television image sig- 
nal as a multiplexed analog broadcast wave, 
while audio data are transmitted as a television 
audio signal, 

an identifier to be shown as an image is trans- 
mitted at a fixed position in non-displayed part 
of an image section, and 
said first detecting means recognizes an iden- 
tifier from an image at a fixed position in said 
non-displayed part. 

38. A receiving apparatus according to Claim 34, 
wherein 

the same identifier is allotted to image data, 
control information, and audio data, said con- 
trol information and audio data corresponding 
to said image data, 

said image data, control information, and audio 
data are converted into digital data streams to 
be multiplexed to transmit a multiplexed stream 
as a multiplexed digital broadcast wave, 
said digital data streams are allotted first iden- 
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tifying information to identify image data, sec- 
ond identifying information to identify control in- 
formation, and third identifying information to 
identify audio data. 

said multiplexed stream comprises said digital $ 
data streams and a map table showing the cor- 
respondence between said first identifying in- 
formatic <*nd image data identifiers; the corre- 
spondence between said second identifying in- 
formation and control information identifiers, to 
and the correspondence between said third 
identifying information and audio data identifi- 
ers, said digital data streams and said map ta- 
ble being multiplexed, 

said storage means stores a map table sepa- ts 
rated by said separating means, 
said control means recognizes an identifier of 
linked image data indicated by control informa- 
tion, converts said identifier into first identifying 
information, second identifying information, 20 
and third identifying information referring to a 
map table, and sets said first identifying infor- 
mation, second identifying information, and 
third identifying information to said separating 
means, and 25 

said separating means comprises: 

first detecting means for detecting said first 
identifying information from said multiplexed so 
stream: 

second detecting means for detecting said sec- 
ond identifying information from said multi- 
plexed stream: 

third detecting means for detecting said third 35 
identifying information from said multiplexed- 
stream: and 

obtaining means for obtaining image data and 
control information indicated by said first, sec- 
ond, and third identifying information detected 4 0 
by said first, second, and third detecting 
means. 

39. A receiving apparatus according to Claim 34, 

wherein 45 

said control information is expressed by at least 
one combination of a coordinate on which an 
image part is centered in image data corre- 
sponding to said control information, and the 50 
identifier allotted to linked image data, 
said operation means receives a user operation 
to designate said image part in image data, and 
said control means reads the identifier allotted 
to linked image data corresponding to said des- 55 
ignated image part, and sets said identifier to 
said separating means. 
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40. A receiving method used in a receiving apparatus 
for an interactive communication system using a 
broadcast wave produced by multiplexing a plurality 
of frames of image data and control information 
showing links between said plurality of frames of im- 
age data, 

characterized by comprising the steps of: 

separating a frame of image data and corre- 
sponding control information from said broad- 
cast wave: 

storing said separated image data and corre- 
sponding control information: 
reproducing said image data stored in a mem- 
ory to output an image signal: 
receiving a user operation to switch image data: 
detecting image data indicated by said control 
information stored in a memory according to 
said user operation: and 
separating said detected image data and cor- 
responding control information from said 
broadcast wave. 

41. A recording medium for recording a receiving pro- 
gram used in a receiving apparatus for an interac- 
tive communication system using a broadcast wave 
produced by multiplexing a plurality of frames of im- 
age data and control information showing links be- 
tween said plurality of frames of image data, 

characterized in that said receiving program 
comprises the steps of: 

separating a frame of image data and corre- 
sponding control information from said broad- 
cast wave: 

storing said separated image data and corre- 
sponding control information: 
reproducing said image data stored in a mem- 
ory to output an image signal: 
receiving a user operation to switch image data: 
detecting image data indicated by said control 
information stored in a memory according to 
said user operation: and 
separating said detected image data and cor- 
responding control information from said 
broadcast wave. 

42. An interactive communication system using a 
broadcast wave, comprising a transmitting appara- 
tus and a receiving apparatus, 

characterized in that 

said transmitting apparatus comprises: 

first storage means for storing a plurality of 
frames of image data: 

second storage means for storing control infor- 
mation, for each frame of image data, showing 
a link to another frame of image data stored in 
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said first storage means; and 
transmitting means for repeatedly transmitting 
a predetermined number of frames of image 
data together with corresponding control infor- 
mation., and 

said receiving apparatus comprises: 

separating means for separating a frame of im- 
age data and corresponding control information 
from said broadcast wave: 
storage means for storing said separated im- 
age data and control information: 
reproducing means for reproducing said stored 
image data to output an image signal: 
operation means for receiving a user operation 
to switch image data: and 
control means for controlling said separating 
means so as to separate another frame of im- 
age data designated by said control information 
stored in said storage means according to said 
user operation. 

43. An interactive communication system according to 
Claim 42, wherein 

said transmitting means comprises: 

reading means for repeatedly reading said pre- 
determined number of frames of image data to- 
gether with said corresponding control informa- 
tion from said first and second storage means: 
multiplexing means for multiplexing image data 
and control information read by said reading 
means by transmitting said image data and 
control information in image sections and ver- 
tical blanking intervals, respectively, of a televi- 
sion signal: and 

output means for outputting the multiplexed tel- 
evision signal as an analog broadcast wave. 

44. An interactive communication system according to 
Claim 42, wherein 

said image data and control information 
stored in said first and second storage means are 
digitized, and 

said transmitting means comprises: 

reading means for repeatedly reading said pre- 
determined number of frames of image data to- 
gether with said corresponding control informa- 
tion from said first and second storage means; 
multiplexing means for converting image data 
and control information read by said reading 
means into digital data streams, and multiplex- 
ing said digital data streams so as to produce 
a multiplexed stream: and 
output means for outputting said multiplexed 
stream as a digital broadcast wave. 



53 

45. An interactive communication system using a 
broadcast wave, comprising a transmitting appara- 
tus and a receiving apparatus, 

characterized in that 
5 said transmitting apparatus comprises: 

first storage means for storing a plurality of 
frames of image data with an identifier allotted 
to each frame of image data: 

10 second storage means for storing control infor- 

mation, for each frame of image data., showing 
a link to another frame of image data stored in 
said first storage means, the same identifier be- 
ing allotted to corresponding image data and 

15 control information: and 

output means for repeatedly outputting a pre- 
determined number of frames of image data to- 
gether with corresponding control information, 
and 

20 

said receiving apparatus comprises: 

separating means for separating a frame of im- 
age data and corresponding control information 

25 from said broadcast wave; 

storage means for storing said separated im- 
age data and control information: 
reproducing means for reproducing said stored 
image data to output an image signal: 

30 operation means for receiving a user operation 

to switch image data: and 
control means for controlling said separating 
means so as to separate another frame of im- 
age data designated by said control information 

35 stored in said storage means according to said 

user operation. 

46. An interactive communication system according to 
Claim 45, wherein 

40 said control information expresses the identi- 

fier of linked image data, and 

said separating means comprises: 

first detecting means for detecting an identifier 
45 allotted to image data from said broadcast 

wave: 

second detecting means for detecting said 
identifier allotted to corresponding control infor- 
mation from said broadcast wave: and 
50 obtaining means for obtaining said image data 

and control information if said first and second 
detecting means have detected said identifier. 

47. An interactive communication system using a 
55 broadcast wave, comprising a transmitting appara- 
tus and a receiving apparatus, 

characterized in that 

said transmitting apparatus comprises: 
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obtaining means for obtaining pieces of page 
information representing a page containing 
characters and images, said page information 
including link information to show a link to an- 
other page, character information, and image s 
information: 

first producing means for producing one frame 
of image data containing characters and imag- 
es in accordance with said character informa- 
tion and image information included in a piece io 
of link information: 

second producing means for producing control 
information, for each frame of image data, 
showing a link to another frame of image data 
by interpreting said link information included in 15 
said page information: 

first storage means for storing a predetermined 
number of frames of image data produced by 
said first producing means: 

second storage means for storing said control 20 
information produced by said second produc- 
ing means: and 

transmitting means for repeatedly transmitting 
said predetermined number of frames of image 
data together with said control information and 25 

said receiving apparatus comprises: 

separating means for separating a frame of im- 
age data and corresponding control information 30 
from said broadcast wave: 
storage means for storing said separated im- 
age data and control information: 
reproducing means for reproducing said stored 
image data to output an image signal: 35 
operation means for receiving a user operation 
to switch image data: and 
control means for controlling said separating 
means so as to separate another frame of im- 
age data designated by said control information 40 
stored in said storage means according to said 
user operation. 
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